Model comparison

Gemma 4 31B IT vs Granite 4.0 H Small

Gemma 4 31B IT is the stronger model overall, scoring 43.2 to 35.9 on the Noometry Index.

Last verified . 14 shared benchmarks.

Gemma 4 31B IT Google

43.2

Rank #85 Confirmed

Granite 4.0 H Small IBM

35.9

Rank #213 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Gemma 4 31B IT scores higher in 8 categories and Granite 4.0 H Small in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemma 4 31B IT leads 60.7 to 44.0.

Side by side

Gemma 4 31B IT and Granite 4.0 H Small specifications
Gemma 4 31B ITGranite 4.0 H Small
ProviderGoogleIBM
Noometry Index43.235.9
Released2026-04-02—
WeightsOpenOpen
Context window262K—
Max output33K—
Input $ / M tokens$0.09—
Output $ / M tokens$0.34—
Results tracked3519

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 4 31B IT leads

Gemma 4 31B IT: 41.9 (#98), Granite 4.0 H Small: 35.8 (#207)

Coding benchmarks
BenchmarkGemma 4 31B ITGranite 4.0 H Small
LMArena Coding14591247
LMArena WebDev1364—
SciCode43.4%—
WeirdML52.3%—
ALE-Bench925.5—

Reasoning Gemma 4 31B IT leads

Gemma 4 31B IT: 26.4 (#119), Granite 4.0 H Small: 23.4 (#164)

Reasoning benchmarks
BenchmarkGemma 4 31B ITGranite 4.0 H Small
LMArena Hard Prompts14481240
Kagi LLM Benchmark63.5%—
NYT Connections (extended)70.6%—
CritPt1.4%—
Chess Puzzles5%—
Thematic Generalization53%—
DTBench82.7%—
LMCA39.3%—
Surface Evolver Bench30.6%—
Epoch Capabilities Index142.74—

Math Gemma 4 31B IT leads

Gemma 4 31B IT: 41.3 (#72), Granite 4.0 H Small: 29.3 (#219)

Math benchmarks
BenchmarkGemma 4 31B ITGranite 4.0 H Small
LMArena Math14641251
OTIS Mock AIME 2024-202573.3%—
Omni-MATH—29.6%

Knowledge Gemma 4 31B IT leads

Gemma 4 31B IT: 37.9 (#141), Granite 4.0 H Small: 31.5 (#210)

Knowledge benchmarks
BenchmarkGemma 4 31B ITGranite 4.0 H Small
Vectara Hallucination Rate7.4%5.2%
LMArena Expert14651244
GPQA Diamond75.8%—
SimpleQA Verified10.4%—
MMLU-Pro—56.9%
GPQA (HELM)—38.3%

Multimodal Not comparable

Gemma 4 31B IT: 41.0 (#32), Granite 4.0 H Small: —

Multimodal benchmarks
BenchmarkGemma 4 31B ITGranite 4.0 H Small
LMArena Vision1278—
LMArena Document1425—

Multilingual Gemma 4 31B IT leads

Gemma 4 31B IT: 54.0 (#52), Granite 4.0 H Small: 38.7 (#223)

Multilingual benchmarks
BenchmarkGemma 4 31B ITGranite 4.0 H Small
LMArena Non-English14311216
LMArena Chinese14781250
LMArena Russian14621198
LMArena Spanish14431258
LMArena French1436—

Instruction Following Gemma 4 31B IT leads

Gemma 4 31B IT: 75.6 (#58), Granite 4.0 H Small: 68.9 (#178)

Instruction Following benchmarks
BenchmarkGemma 4 31B ITGranite 4.0 H Small
LMArena Instruction Following14331221
IFEval—89%

Long Context Gemma 4 31B IT leads

Gemma 4 31B IT: 44.2 (#67), Granite 4.0 H Small: 37.6 (#209)

Long Context benchmarks
BenchmarkGemma 4 31B ITGranite 4.0 H Small
LMArena Longer Query14461240

Writing & Preference Gemma 4 31B IT leads

Gemma 4 31B IT: 60.7 (#92), Granite 4.0 H Small: 44.0 (#222)

Writing & Preference benchmarks
BenchmarkGemma 4 31B ITGranite 4.0 H Small
LMArena Text14431241
LMArena Creative Writing14161210
LMArena Multi-Turn14521243
EQ-Bench Creative Writing1368—
WildBench—73.9%
EQ-Bench 41120—

Frequently asked questions

Is Gemma 4 31B IT better than Granite 4.0 H Small?

Gemma 4 31B IT is the stronger model overall, scoring 43.2 to 35.9 on the Noometry Index.

Is Gemma 4 31B IT or Granite 4.0 H Small better for coding?

Gemma 4 31B IT scores higher on coding benchmarks: 41.9 versus 35.8 in the Noometry coding category.

How many benchmarks do Gemma 4 31B IT and Granite 4.0 H Small share?

14 benchmarks have published results for both models. Gemma 4 31B IT has 35 scored results on Noometry and Granite 4.0 H Small has 19.

Related comparisons

Go deeper