Model comparison

Gemma 1.1 7b IT vs Granite 4.2 3b

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 31.3 on the Noometry Index.

Last verified . 11 shared benchmarks.

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Granite 4.2 3b IBM

39.4

Rank #169 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Gemma 1.1 7b IT scores higher in 0 categories and Granite 4.2 3b in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.2 3b leads 47.2 to 30.4.

Side by side

Gemma 1.1 7b IT and Granite 4.2 3b specifications
Gemma 1.1 7b ITGranite 4.2 3b
ProviderGoogleIBM
Noometry Index31.339.4
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1911

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 3b leads

Gemma 1.1 7b IT: 31.5 (#284), Granite 4.2 3b: 40.0 (#151)

Coding benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 3b
LMArena Coding10841361
HumanEval+35.4%—
MBPP+45%—

Reasoning Granite 4.2 3b leads

Gemma 1.1 7b IT: 20.5 (#238), Granite 4.2 3b: 26.0 (#138)

Reasoning benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 3b
LMArena Hard Prompts10711306

Math Not comparable

Gemma 1.1 7b IT: 32.0 (#220), Granite 4.2 3b: —

Math benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 3b
LMArena Math1107—

Knowledge Granite 4.2 3b leads

Gemma 1.1 7b IT: 28.3 (#247), Granite 4.2 3b: 36.3 (#171)

Knowledge benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 3b
LMArena Expert10391315

Multilingual Granite 4.2 3b leads

Gemma 1.1 7b IT: 28.1 (#273), Granite 4.2 3b: 42.1 (#198)

Multilingual benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 3b
LMArena Non-English10521268
LMArena Chinese10611269
LMArena Russian10461249
LMArena French1065—
LMArena German1054—
LMArena Japanese971—
LMArena Korean988—
LMArena Spanish1049—

Instruction Following Granite 4.2 3b leads

Gemma 1.1 7b IT: 54.0 (#283), Granite 4.2 3b: 67.1 (#200)

Instruction Following benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 3b
LMArena Instruction Following10571273

Long Context Granite 4.2 3b leads

Gemma 1.1 7b IT: 32.1 (#272), Granite 4.2 3b: 39.2 (#185)

Long Context benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 3b
LMArena Longer Query10561291

Writing & Preference Granite 4.2 3b leads

Gemma 1.1 7b IT: 30.4 (#288), Granite 4.2 3b: 47.2 (#212)

Writing & Preference benchmarks
BenchmarkGemma 1.1 7b ITGranite 4.2 3b
LMArena Text10941293
LMArena Creative Writing10601205
LMArena Multi-Turn10401290

Frequently asked questions

Is Gemma 1.1 7b IT better than Granite 4.2 3b?

Granite 4.2 3b is the stronger model overall, scoring 39.4 to 31.3 on the Noometry Index.

Is Gemma 1.1 7b IT or Granite 4.2 3b better for coding?

Granite 4.2 3b scores higher on coding benchmarks: 40.0 versus 31.5 in the Noometry coding category.

How many benchmarks do Gemma 1.1 7b IT and Granite 4.2 3b share?

11 benchmarks have published results for both models. Gemma 1.1 7b IT has 19 scored results on Noometry and Granite 4.2 3b has 11.

Related comparisons

Go deeper