Model comparison

Granite 4.2 3b vs Qwen-14B

Granite 4.2 3b is the stronger model overall, scoring 39.0 to 30.8 on the Noometry Index.

Last verified . 9 shared benchmarks.

Granite 4.2 3b IBM

39.0

Rank #163 Confirmed

Qwen-14B Alibaba (Qwen)

30.8

Rank #273 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Granite 4.2 3b scores higher in 6 categories and Qwen-14B in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.2 3b leads 47.9 to 27.8.

Side by side

Granite 4.2 3b and Qwen-14B specifications
Granite 4.2 3bQwen-14B
ProviderIBMAlibaba (Qwen)
Noometry Index39.030.8
Released—2023-09-24
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1118

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 3b leads

Granite 4.2 3b: 39.4 (#146), Qwen-14B: 30.6 (#283)

Coding benchmarks
BenchmarkGranite 4.2 3bQwen-14B
LMArena Coding13631072

Reasoning Granite 4.2 3b leads

Granite 4.2 3b: 25.0 (#136), Qwen-14B: 18.7 (#255)

Reasoning benchmarks
BenchmarkGranite 4.2 3bQwen-14B
LMArena Hard Prompts13081027
BIG-Bench Hard—55%
Epoch Capabilities Index—112.8
LAMBADA—71.1%
PIQA—79.9%

Math Not comparable

Granite 4.2 3b: —, Qwen-14B: 28.7 (#224)

Math benchmarks
BenchmarkGranite 4.2 3bQwen-14B
LMArena Math—1068
GSM8K—61.3%

Knowledge Not comparable

Granite 4.2 3b: 35.6 (#169), Qwen-14B: —

Knowledge benchmarks
BenchmarkGranite 4.2 3bQwen-14B
LMArena Expert1313—
ARC (AI2) Challenge—84.4%
BoolQ—86.2%
MMLU—66.3%

Multilingual Granite 4.2 3b leads

Granite 4.2 3b: 42.4 (#193), Qwen-14B: 27.7 (#270)

Multilingual benchmarks
BenchmarkGranite 4.2 3bQwen-14B
LMArena Non-English12681042
LMArena Chinese12681077
LMArena Russian1249—

Instruction Following Granite 4.2 3b leads

Granite 4.2 3b: 67.2 (#195), Qwen-14B: 52.6 (#284)

Instruction Following benchmarks
BenchmarkGranite 4.2 3bQwen-14B
LMArena Instruction Following12711031

Long Context Granite 4.2 3b leads

Granite 4.2 3b: 39.3 (#179), Qwen-14B: 31.3 (#276)

Long Context benchmarks
BenchmarkGranite 4.2 3bQwen-14B
LMArena Longer Query12931029

Writing & Preference Granite 4.2 3b leads

Granite 4.2 3b: 47.9 (#202), Qwen-14B: 27.8 (#294)

Writing & Preference benchmarks
BenchmarkGranite 4.2 3bQwen-14B
LMArena Text12951051
LMArena Creative Writing12151028
LMArena Multi-Turn12931022

Frequently asked questions

Is Granite 4.2 3b better than Qwen-14B?

Granite 4.2 3b is the stronger model overall, scoring 39.0 to 30.8 on the Noometry Index.

Is Granite 4.2 3b or Qwen-14B better for coding?

Granite 4.2 3b scores higher on coding benchmarks: 39.4 versus 30.6 in the Noometry coding category.

How many benchmarks do Granite 4.2 3b and Qwen-14B share?

9 benchmarks have published results for both models. Granite 4.2 3b has 11 scored results on Noometry and Qwen-14B has 18.

Related comparisons

Go deeper