Model comparison

Granite 4.2 8B vs Qwen1.5-110B

Granite 4.2 8B is the stronger model overall, scoring 40.5 to 34.2 on the Noometry Index.

Last verified . 11 shared benchmarks.

Granite 4.2 8B IBM

40.5

Rank #148 Confirmed

Qwen1.5-110B Alibaba (Qwen)

34.2

Rank #234 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Granite 4.2 8B scores higher in 7 categories and Qwen1.5-110B in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.2 8B leads 49.6 to 38.0.

Side by side

Granite 4.2 8B and Qwen1.5-110B specifications
Granite 4.2 8BQwen1.5-110B
ProviderIBMAlibaba (Qwen)
Noometry Index40.534.2
Released—2024-04-25
WeightsOpenOpen
Context window131K—
Max output118K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.25—
Results tracked1120

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 8B leads

Granite 4.2 8B: 40.5 (#137), Qwen1.5-110B: 33.0 (#264)

Coding benchmarks
BenchmarkGranite 4.2 8BQwen1.5-110B
LMArena Coding13801184
BigCodeBench Instruct—35%
BigCodeBench Complete—44.4%

Reasoning Granite 4.2 8B leads

Granite 4.2 8B: 26.6 (#131), Qwen1.5-110B: 22.7 (#189)

Reasoning benchmarks
BenchmarkGranite 4.2 8BQwen1.5-110B
LMArena Hard Prompts13291168
ForecastBench—57.7

Math Not comparable

Granite 4.2 8B: —, Qwen1.5-110B: 33.7 (#201)

Math benchmarks
BenchmarkGranite 4.2 8BQwen1.5-110B
LMArena Math—1185

Knowledge Granite 4.2 8B leads

Granite 4.2 8B: 38.4 (#145), Qwen1.5-110B: 31.2 (#219)

Knowledge benchmarks
BenchmarkGranite 4.2 8BQwen1.5-110B
LMArena Expert13841144

Multilingual Granite 4.2 8B leads

Granite 4.2 8B: 44.5 (#178), Qwen1.5-110B: 33.6 (#250)

Multilingual benchmarks
BenchmarkGranite 4.2 8BQwen1.5-110B
LMArena Non-English13021142
LMArena Chinese13661206
LMArena Russian12851118
LMArena French—1151
LMArena German—1123
LMArena Japanese—1074
LMArena Korean—1044
LMArena Spanish—1142

Instruction Following Granite 4.2 8B leads

Granite 4.2 8B: 68.7 (#184), Qwen1.5-110B: 60.3 (#252)

Instruction Following benchmarks
BenchmarkGranite 4.2 8BQwen1.5-110B
LMArena Instruction Following13011158

Long Context Granite 4.2 8B leads

Granite 4.2 8B: 40.3 (#159), Qwen1.5-110B: 35.1 (#242)

Long Context benchmarks
BenchmarkGranite 4.2 8BQwen1.5-110B
LMArena Longer Query13241157

Writing & Preference Granite 4.2 8B leads

Granite 4.2 8B: 49.6 (#189), Qwen1.5-110B: 38.0 (#255)

Writing & Preference benchmarks
BenchmarkGranite 4.2 8BQwen1.5-110B
LMArena Text13201175
LMArena Creative Writing12361148
LMArena Multi-Turn13011160

Frequently asked questions

Is Granite 4.2 8B better than Qwen1.5-110B?

Granite 4.2 8B is the stronger model overall, scoring 40.5 to 34.2 on the Noometry Index.

Is Granite 4.2 8B or Qwen1.5-110B better for coding?

Granite 4.2 8B scores higher on coding benchmarks: 40.5 versus 33.0 in the Noometry coding category.

How many benchmarks do Granite 4.2 8B and Qwen1.5-110B share?

11 benchmarks have published results for both models. Granite 4.2 8B has 11 scored results on Noometry and Qwen1.5-110B has 20.

Related comparisons

Go deeper