Model comparison

Granite 4.0 H Small vs Olmo 3 32b Think

Olmo 3 32b Think is the stronger model overall, scoring 38.1 to 35.9 on the Noometry Index.

Last verified . 12 shared benchmarks.

Granite 4.0 H Small IBM

35.9

Rank #213 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Granite 4.0 H Small scores higher in 1 category and Olmo 3 32b Think in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Olmo 3 32b Think leads 49.2 to 44.0.

Side by side

Granite 4.0 H Small and Olmo 3 32b Think specifications
Granite 4.0 H SmallOlmo 3 32b Think
ProviderIBMAllen Institute for AI (Ai2)
Noometry Index35.938.1
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1914

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Olmo 3 32b Think leads

Granite 4.0 H Small: 35.8 (#207), Olmo 3 32b Think: 38.0 (#169)

Coding benchmarks
BenchmarkGranite 4.0 H SmallOlmo 3 32b Think
LMArena Coding12471318

Reasoning Olmo 3 32b Think leads

Granite 4.0 H Small: 23.4 (#164), Olmo 3 32b Think: 24.9 (#138)

Reasoning benchmarks
BenchmarkGranite 4.0 H SmallOlmo 3 32b Think
LMArena Hard Prompts12401302

Math Olmo 3 32b Think leads

Granite 4.0 H Small: 29.3 (#219), Olmo 3 32b Think: 33.8 (#165)

Math benchmarks
BenchmarkGranite 4.0 H SmallOlmo 3 32b Think
LMArena Math12511315
Omni-MATH29.6%—

Knowledge Olmo 3 32b Think leads

Granite 4.0 H Small: 31.5 (#210), Olmo 3 32b Think: 34.4 (#189)

Knowledge benchmarks
BenchmarkGranite 4.0 H SmallOlmo 3 32b Think
LMArena Expert12441272
MMLU-Pro56.9%—
Vectara Hallucination Rate5.2%—
GPQA (HELM)38.3%—

Multilingual Olmo 3 32b Think leads

Granite 4.0 H Small: 38.7 (#223), Olmo 3 32b Think: 41.4 (#205)

Multilingual benchmarks
BenchmarkGranite 4.0 H SmallOlmo 3 32b Think
LMArena Non-English12161255
LMArena Chinese12501300
LMArena Russian11981255
LMArena French—1291
LMArena German—1290
LMArena Spanish1258—

Instruction Following Granite 4.0 H Small leads

Granite 4.0 H Small: 68.9 (#178), Olmo 3 32b Think: 67.4 (#193)

Instruction Following benchmarks
BenchmarkGranite 4.0 H SmallOlmo 3 32b Think
LMArena Instruction Following12211275
IFEval89%—

Long Context Olmo 3 32b Think leads

Granite 4.0 H Small: 37.6 (#209), Olmo 3 32b Think: 39.4 (#177)

Long Context benchmarks
BenchmarkGranite 4.0 H SmallOlmo 3 32b Think
LMArena Longer Query12401296

Writing & Preference Olmo 3 32b Think leads

Granite 4.0 H Small: 44.0 (#222), Olmo 3 32b Think: 49.2 (#188)

Writing & Preference benchmarks
BenchmarkGranite 4.0 H SmallOlmo 3 32b Think
LMArena Text12411300
LMArena Creative Writing12101256
LMArena Multi-Turn12431289
WildBench73.9%—

Frequently asked questions

Is Granite 4.0 H Small better than Olmo 3 32b Think?

Olmo 3 32b Think is the stronger model overall, scoring 38.1 to 35.9 on the Noometry Index.

Is Granite 4.0 H Small or Olmo 3 32b Think better for coding?

Olmo 3 32b Think scores higher on coding benchmarks: 38.0 versus 35.8 in the Noometry coding category.

How many benchmarks do Granite 4.0 H Small and Olmo 3 32b Think share?

12 benchmarks have published results for both models. Granite 4.0 H Small has 19 scored results on Noometry and Olmo 3 32b Think has 14.

Related comparisons

Go deeper