Model comparison

Granite 4.2 3b vs Qwen2-72B

Granite 4.2 3b is the stronger model overall, scoring 39.0 to 29.5 on the Noometry Index.

Last verified . 11 shared benchmarks.

Granite 4.2 3b IBM

39.0

Rank #163 Confirmed

Qwen2-72B Alibaba (Qwen)

29.5

Rank #294 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Granite 4.2 3b scores higher in 7 categories and Qwen2-72B in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.2 3b leads 35.6 to 21.2.

Side by side

Granite 4.2 3b and Qwen2-72B specifications
Granite 4.2 3bQwen2-72B
ProviderIBMAlibaba (Qwen)
Noometry Index39.029.5
Released—2024-06-07
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1126

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 3b leads

Granite 4.2 3b: 39.4 (#146), Qwen2-72B: 28.7 (#303)

Coding benchmarks
BenchmarkGranite 4.2 3bQwen2-72B
LMArena Coding13631196
WeirdML—11.3%
BigCodeBench Instruct—38.5%
BigCodeBench Complete—54%

Agentic & Tool Use Not comparable

Granite 4.2 3b: —, Qwen2-72B: 16.9 (#138)

Agentic & Tool Use benchmarks
BenchmarkGranite 4.2 3bQwen2-72B
TheAgentCompany—1.1%
METR Time Horizons—29.9%

Reasoning Granite 4.2 3b leads

Granite 4.2 3b: 25.0 (#136), Qwen2-72B: 22.2 (#184)

Reasoning benchmarks
BenchmarkGranite 4.2 3bQwen2-72B
LMArena Hard Prompts13081191
Epoch Capabilities Index—125.27

Math Not comparable

Granite 4.2 3b: —, Qwen2-72B: 27.9 (#232)

Math benchmarks
BenchmarkGranite 4.2 3bQwen2-72B
LMArena Math—1235
MATH Level 5—39.1%

Knowledge Granite 4.2 3b leads

Granite 4.2 3b: 35.6 (#169), Qwen2-72B: 21.2 (#270)

Knowledge benchmarks
BenchmarkGranite 4.2 3bQwen2-72B
LMArena Expert13131171
GPQA Diamond—40.8%
MMLU—82.4%

Multilingual Granite 4.2 3b leads

Granite 4.2 3b: 42.4 (#193), Qwen2-72B: 36.0 (#239)

Multilingual benchmarks
BenchmarkGranite 4.2 3bQwen2-72B
LMArena Non-English12681176
LMArena Chinese12681240
LMArena Russian12491169
LMArena French—1169
LMArena German—1151
LMArena Japanese—1111
LMArena Korean—1083
LMArena Spanish—1168

Instruction Following Granite 4.2 3b leads

Granite 4.2 3b: 67.2 (#195), Qwen2-72B: 62.0 (#236)

Instruction Following benchmarks
BenchmarkGranite 4.2 3bQwen2-72B
LMArena Instruction Following12711181

Long Context Granite 4.2 3b leads

Granite 4.2 3b: 39.3 (#179), Qwen2-72B: 36.1 (#230)

Long Context benchmarks
BenchmarkGranite 4.2 3bQwen2-72B
LMArena Longer Query12931193

Writing & Preference Granite 4.2 3b leads

Granite 4.2 3b: 47.9 (#202), Qwen2-72B: 41.0 (#236)

Writing & Preference benchmarks
BenchmarkGranite 4.2 3bQwen2-72B
LMArena Text12951203
LMArena Creative Writing12151181
LMArena Multi-Turn12931195

Frequently asked questions

Is Granite 4.2 3b better than Qwen2-72B?

Granite 4.2 3b is the stronger model overall, scoring 39.0 to 29.5 on the Noometry Index.

Is Granite 4.2 3b or Qwen2-72B better for coding?

Granite 4.2 3b scores higher on coding benchmarks: 39.4 versus 28.7 in the Noometry coding category.

How many benchmarks do Granite 4.2 3b and Qwen2-72B share?

11 benchmarks have published results for both models. Granite 4.2 3b has 11 scored results on Noometry and Qwen2-72B has 26.

Related comparisons

Go deeper