Model comparison

Gemma 2 9B vs Granite 4.2 30b

Granite 4.2 30b is the stronger model overall, scoring 41.8 to 25.9 on the Noometry Index.

Last verified . 11 shared benchmarks.

Gemma 2 9B Google

25.9

Rank #341 Confirmed

Granite 4.2 30b IBM

41.8

Rank #130 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Gemma 2 9B scores higher in 0 categories and Granite 4.2 30b in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.2 30b leads 39.1 to 9.7.

Side by side

Gemma 2 9B and Granite 4.2 30b specifications
Gemma 2 9BGranite 4.2 30b
ProviderGoogleIBM
Noometry Index25.941.8
Released2024-06-24—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3511

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 30b leads

Gemma 2 9B: 29.4 (#304), Granite 4.2 30b: 41.0 (#126)

Coding benchmarks
BenchmarkGemma 2 9BGranite 4.2 30b
LMArena Coding11731396
BigCodeBench Instruct34.7%—
LiveBench Coding22.5%—
BigCodeBench Complete40.6%—

Reasoning Granite 4.2 30b leads

Gemma 2 9B: 15.9 (#309), Granite 4.2 30b: 27.8 (#112)

Reasoning benchmarks
BenchmarkGemma 2 9BGranite 4.2 30b
LMArena Hard Prompts11711374
LiveBench Reasoning15.2%—
LiveBench Data Analysis36.4%—
Epoch Capabilities Index119.83—
LiveBench28.7%—
PIQA83.7%—

Math Not comparable

Gemma 2 9B: 9.9 (#318), Granite 4.2 30b: —

Math benchmarks
BenchmarkGemma 2 9BGranite 4.2 30b
OTIS Mock AIME 2024-20250.6%—
LiveBench Math19.8%—
LMArena Math1183—
MATH Level 521%—
GSM8K84.9%—

Knowledge Granite 4.2 30b leads

Gemma 2 9B: 9.7 (#305), Granite 4.2 30b: 39.1 (#138)

Knowledge benchmarks
BenchmarkGemma 2 9BGranite 4.2 30b
LMArena Expert11471406
GPQA Diamond27.5%—
BoolQ85.7%—
MMLU72.1%—

Multilingual Granite 4.2 30b leads

Gemma 2 9B: 36.6 (#238), Granite 4.2 30b: 47.3 (#151)

Multilingual benchmarks
BenchmarkGemma 2 9BGranite 4.2 30b
LMArena Non-English11881340
LMArena Chinese11851414
LMArena Russian12001343
LMArena French1190—
LMArena German1186—
LMArena Japanese1144—
LMArena Korean1137—
LMArena Spanish1200—

Instruction Following Granite 4.2 30b leads

Gemma 2 9B: 57.6 (#269), Granite 4.2 30b: 71.2 (#155)

Instruction Following benchmarks
BenchmarkGemma 2 9BGranite 4.2 30b
LMArena Instruction Following11781347
LiveBench Instruction Following52.6%—

Long Context Granite 4.2 30b leads

Gemma 2 9B: 36.3 (#233), Granite 4.2 30b: 41.4 (#140)

Long Context benchmarks
BenchmarkGemma 2 9BGranite 4.2 30b
LMArena Longer Query11971359

Writing & Preference Granite 4.2 30b leads

Gemma 2 9B: 32.1 (#281), Granite 4.2 30b: 53.8 (#156)

Writing & Preference benchmarks
BenchmarkGemma 2 9BGranite 4.2 30b
LMArena Text12071361
LMArena Creative Writing12061288
LMArena Multi-Turn11931339
EQ-Bench Creative Writing841—
LiveBench Language25.5%—

Frequently asked questions

Is Gemma 2 9B better than Granite 4.2 30b?

Granite 4.2 30b is the stronger model overall, scoring 41.8 to 25.9 on the Noometry Index.

Is Gemma 2 9B or Granite 4.2 30b better for coding?

Granite 4.2 30b scores higher on coding benchmarks: 41.0 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2 9B and Granite 4.2 30b share?

11 benchmarks have published results for both models. Gemma 2 9B has 35 scored results on Noometry and Granite 4.2 30b has 11.

Related comparisons

Go deeper