Model comparison

Granite 4.2 3b vs Qwen1.5-72B

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 30.8 on the Noometry Index.

Last verified . 11 shared benchmarks.

Granite 4.2 3b IBM

39.4

Rank #169 Confirmed

Qwen1.5-72B Alibaba (Qwen)

30.8

Rank #285 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Granite 4.2 3b scores higher in 7 categories and Qwen1.5-72B in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.2 3b leads 36.3 to 11.5.

Side by side

Granite 4.2 3b and Qwen1.5-72B specifications
Granite 4.2 3bQwen1.5-72B
ProviderIBMAlibaba (Qwen)
Noometry Index39.430.8
Released—2024-02-04
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1122

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 3b leads

Granite 4.2 3b: 40.0 (#151), Qwen1.5-72B: 31.9 (#277)

Coding benchmarks
BenchmarkGranite 4.2 3bQwen1.5-72B
LMArena Coding13611165
BigCodeBench Instruct—33.2%
BigCodeBench Complete—40.3%
HumanEval+—59.1%
MBPP+—61.6%

Reasoning Granite 4.2 3b leads

Granite 4.2 3b: 26.0 (#138), Qwen1.5-72B: 22.2 (#203)

Reasoning benchmarks
BenchmarkGranite 4.2 3bQwen1.5-72B
LMArena Hard Prompts13061148

Math Not comparable

Granite 4.2 3b: —, Qwen1.5-72B: 33.2 (#205)

Math benchmarks
BenchmarkGranite 4.2 3bQwen1.5-72B
LMArena Math—1164

Knowledge Granite 4.2 3b leads

Granite 4.2 3b: 36.3 (#171), Qwen1.5-72B: 11.5 (#300)

Knowledge benchmarks
BenchmarkGranite 4.2 3bQwen1.5-72B
LMArena Expert13151136
GPQA Diamond—28.8%

Multilingual Granite 4.2 3b leads

Granite 4.2 3b: 42.1 (#198), Qwen1.5-72B: 33.2 (#253)

Multilingual benchmarks
BenchmarkGranite 4.2 3bQwen1.5-72B
LMArena Non-English12681135
LMArena Chinese12691186
LMArena Russian12491104
LMArena French—1159
LMArena German—1084
LMArena Japanese—1061
LMArena Korean—1050
LMArena Spanish—1110

Instruction Following Granite 4.2 3b leads

Granite 4.2 3b: 67.1 (#200), Qwen1.5-72B: 59.3 (#256)

Instruction Following benchmarks
BenchmarkGranite 4.2 3bQwen1.5-72B
LMArena Instruction Following12731141

Long Context Granite 4.2 3b leads

Granite 4.2 3b: 39.2 (#185), Qwen1.5-72B: 35.1 (#243)

Long Context benchmarks
BenchmarkGranite 4.2 3bQwen1.5-72B
LMArena Longer Query12911157

Writing & Preference Granite 4.2 3b leads

Granite 4.2 3b: 47.2 (#212), Qwen1.5-72B: 37.3 (#258)

Writing & Preference benchmarks
BenchmarkGranite 4.2 3bQwen1.5-72B
LMArena Text12931166
LMArena Creative Writing12051137
LMArena Multi-Turn12901160

Frequently asked questions

Is Granite 4.2 3b better than Qwen1.5-72B?

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 30.8 on the Noometry Index.

Is Granite 4.2 3b or Qwen1.5-72B better for coding?

Granite 4.2 3b scores higher on coding benchmarks: 40.0 versus 31.9 in the Noometry coding category.

How many benchmarks do Granite 4.2 3b and Qwen1.5-72B share?

11 benchmarks have published results for both models. Granite 4.2 3b has 11 scored results on Noometry and Qwen1.5-72B has 22.

Related comparisons

Go deeper