Model comparison

Granite 4.2 8B vs Qwen2-72B

Granite 4.2 8B is the stronger model overall, scoring 40.5 to 30.0 on the Noometry Index.

Last verified . 11 shared benchmarks.

Granite 4.2 8B IBM

40.5

Rank #148 Confirmed

Qwen2-72B Alibaba (Qwen)

30.0

Rank #300 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Granite 4.2 8B scores higher in 7 categories and Qwen2-72B in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.2 8B leads 38.4 to 21.2.

Side by side

Granite 4.2 8B and Qwen2-72B specifications
Granite 4.2 8BQwen2-72B
ProviderIBMAlibaba (Qwen)
Noometry Index40.530.0
Released—2024-06-07
WeightsOpenOpen
Context window131K—
Max output118K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.25—
Results tracked1126

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 8B leads

Granite 4.2 8B: 40.5 (#137), Qwen2-72B: 29.1 (#310)

Coding benchmarks
BenchmarkGranite 4.2 8BQwen2-72B
LMArena Coding13801196
WeirdML—11.3%
BigCodeBench Instruct—38.5%
BigCodeBench Complete—54%

Agentic & Tool Use Not comparable

Granite 4.2 8B: —, Qwen2-72B: 17.0 (#146)

Agentic & Tool Use benchmarks
BenchmarkGranite 4.2 8BQwen2-72B
TheAgentCompany—1.1%
METR Time Horizons—29.9%

Reasoning Granite 4.2 8B leads

Granite 4.2 8B: 26.6 (#131), Qwen2-72B: 23.2 (#181)

Reasoning benchmarks
BenchmarkGranite 4.2 8BQwen2-72B
LMArena Hard Prompts13291191
Epoch Capabilities Index—125.28

Math Not comparable

Granite 4.2 8B: —, Qwen2-72B: 30.2 (#236)

Math benchmarks
BenchmarkGranite 4.2 8BQwen2-72B
LMArena Math—1235
MATH Level 5—39.1%

Knowledge Granite 4.2 8B leads

Granite 4.2 8B: 38.4 (#145), Qwen2-72B: 21.2 (#275)

Knowledge benchmarks
BenchmarkGranite 4.2 8BQwen2-72B
LMArena Expert13841171
GPQA Diamond—40.8%
MMLU—82.4%

Multilingual Granite 4.2 8B leads

Granite 4.2 8B: 44.5 (#178), Qwen2-72B: 35.9 (#244)

Multilingual benchmarks
BenchmarkGranite 4.2 8BQwen2-72B
LMArena Non-English13021176
LMArena Chinese13661240
LMArena Russian12851169
LMArena French—1170
LMArena German—1151
LMArena Japanese—1111
LMArena Korean—1083
LMArena Spanish—1169

Instruction Following Granite 4.2 8B leads

Granite 4.2 8B: 68.7 (#184), Qwen2-72B: 61.7 (#241)

Instruction Following benchmarks
BenchmarkGranite 4.2 8BQwen2-72B
LMArena Instruction Following13011181

Long Context Granite 4.2 8B leads

Granite 4.2 8B: 40.3 (#159), Qwen2-72B: 36.1 (#235)

Long Context benchmarks
BenchmarkGranite 4.2 8BQwen2-72B
LMArena Longer Query13241192

Writing & Preference Granite 4.2 8B leads

Granite 4.2 8B: 49.6 (#189), Qwen2-72B: 40.8 (#241)

Writing & Preference benchmarks
BenchmarkGranite 4.2 8BQwen2-72B
LMArena Text13201203
LMArena Creative Writing12361181
LMArena Multi-Turn13011196

Frequently asked questions

Is Granite 4.2 8B better than Qwen2-72B?

Granite 4.2 8B is the stronger model overall, scoring 40.5 to 30.0 on the Noometry Index.

Is Granite 4.2 8B or Qwen2-72B better for coding?

Granite 4.2 8B scores higher on coding benchmarks: 40.5 versus 29.1 in the Noometry coding category.

How many benchmarks do Granite 4.2 8B and Qwen2-72B share?

11 benchmarks have published results for both models. Granite 4.2 8B has 11 scored results on Noometry and Qwen2-72B has 26.

Related comparisons

Go deeper