Model comparison

Gemma 1.1 7b IT vs Granite 4.2 8B

Granite 4.2 8B is the stronger model overall, scoring 40.5 to 31.3 on the Noometry Index.

Last verified . 11 shared benchmarks.

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Granite 4.2 8B IBM

40.5

Rank #148 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Gemma 1.1 7b IT scores higher in 0 categories and Granite 4.2 8B in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.2 8B leads 49.6 to 30.4.

Side by side

Gemma 1.1 7b IT and Granite 4.2 8B specifications
Gemma 1.1 7b ITGranite 4.2 8B
ProviderGoogleIBM
Noometry Index31.340.5
Released——
WeightsOpenOpen
Context window—131K
Max output—118K
Input $ / M tokens—$0.06
Output $ / M tokens—$0.25
Results tracked1911

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 8B leads

Gemma 1.1 7b IT: 31.5 (#284), Granite 4.2 8B: 40.5 (#137)

Coding benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 8B
LMArena Coding10841380
HumanEval+35.4%—
MBPP+45%—

Reasoning Granite 4.2 8B leads

Gemma 1.1 7b IT: 20.5 (#238), Granite 4.2 8B: 26.6 (#131)

Reasoning benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 8B
LMArena Hard Prompts10711329

Math Not comparable

Gemma 1.1 7b IT: 32.0 (#220), Granite 4.2 8B: —

Math benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 8B
LMArena Math1107—

Knowledge Granite 4.2 8B leads

Gemma 1.1 7b IT: 28.3 (#247), Granite 4.2 8B: 38.4 (#145)

Knowledge benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 8B
LMArena Expert10391384

Multilingual Granite 4.2 8B leads

Gemma 1.1 7b IT: 28.1 (#273), Granite 4.2 8B: 44.5 (#178)

Multilingual benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 8B
LMArena Non-English10521302
LMArena Chinese10611366
LMArena Russian10461285
LMArena French1065—
LMArena German1054—
LMArena Japanese971—
LMArena Korean988—
LMArena Spanish1049—

Instruction Following Granite 4.2 8B leads

Gemma 1.1 7b IT: 54.0 (#283), Granite 4.2 8B: 68.7 (#184)

Instruction Following benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 8B
LMArena Instruction Following10571301

Long Context Granite 4.2 8B leads

Gemma 1.1 7b IT: 32.1 (#272), Granite 4.2 8B: 40.3 (#159)

Long Context benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 8B
LMArena Longer Query10561324

Writing & Preference Granite 4.2 8B leads

Gemma 1.1 7b IT: 30.4 (#288), Granite 4.2 8B: 49.6 (#189)

Writing & Preference benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 8B
LMArena Text10941320
LMArena Creative Writing10601236
LMArena Multi-Turn10401301

Frequently asked questions

Is Gemma 1.1 7b IT better than Granite 4.2 8B?

Granite 4.2 8B is the stronger model overall, scoring 40.5 to 31.3 on the Noometry Index.

Is Gemma 1.1 7b IT or Granite 4.2 8B better for coding?

Granite 4.2 8B scores higher on coding benchmarks: 40.5 versus 31.5 in the Noometry coding category.

How many benchmarks do Gemma 1.1 7b IT and Granite 4.2 8B share?

11 benchmarks have published results for both models. Gemma 1.1 7b IT has 19 scored results on Noometry and Granite 4.2 8B has 11.

Related comparisons

Go deeper