Model comparison

Granite 4.1 8b vs Granite 4.0 H Small

Granite 4.1 8b and Granite 4.0 H Small score almost the same on the Noometry Index (37.4 vs 36.5), so choose on price, context window or the category you care about most.

Last verified . 12 shared benchmarks.

Granite 4.1 8b IBM

37.4

Rank #205 Confirmed

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Granite 4.1 8b scores higher in 6 categories and Granite 4.0 H Small in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Granite 4.0 H Small leads 36.4 to 30.1.

Side by side

Granite 4.1 8b and Granite 4.0 H Small specifications
Granite 4.1 8bGranite 4.0 H Small
ProviderIBMIBM
Noometry Index37.436.5
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1319

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.0 H Small leads

Granite 4.1 8b: 30.1 (#297), Granite 4.0 H Small: 36.4 (#209)

Coding benchmarks
BenchmarkGranite 4.1 8bGranite 4.0 H Small
LMArena Coding13121249
LMArena WebDev1192—

Reasoning Granite 4.1 8b leads

Granite 4.1 8b: 25.7 (#143), Granite 4.0 H Small: 24.4 (#163)

Reasoning benchmarks
BenchmarkGranite 4.1 8bGranite 4.0 H Small
LMArena Hard Prompts12931240

Math Granite 4.1 8b leads

Granite 4.1 8b: 36.4 (#166), Granite 4.0 H Small: 31.4 (#223)

Math benchmarks
BenchmarkGranite 4.1 8bGranite 4.0 H Small
LMArena Math13121247
Omni-MATH—29.6%

Knowledge Granite 4.1 8b leads

Granite 4.1 8b: 36.1 (#174), Granite 4.0 H Small: 32.0 (#215)

Knowledge benchmarks
BenchmarkGranite 4.1 8bGranite 4.0 H Small
LMArena Expert13091251
MMLU-Pro—56.9%
Vectara Hallucination Rate—5.2%
GPQA (HELM)—38.3%

Multilingual Granite 4.1 8b leads

Granite 4.1 8b: 41.7 (#204), Granite 4.0 H Small: 38.6 (#228)

Multilingual benchmarks
BenchmarkGranite 4.1 8bGranite 4.0 H Small
LMArena Non-English12611216
LMArena Chinese13371249
LMArena Russian12401201
LMArena Spanish—1258

Instruction Following Granite 4.0 H Small leads

Granite 4.1 8b: 66.9 (#203), Granite 4.0 H Small: 68.7 (#183)

Instruction Following benchmarks
BenchmarkGranite 4.1 8bGranite 4.0 H Small
LMArena Instruction Following12691222
IFEval—89%

Long Context Granite 4.1 8b leads

Granite 4.1 8b: 38.7 (#193), Granite 4.0 H Small: 37.7 (#213)

Long Context benchmarks
BenchmarkGranite 4.1 8bGranite 4.0 H Small
LMArena Longer Query12751242

Writing & Preference Granite 4.1 8b leads

Granite 4.1 8b: 48.1 (#204), Granite 4.0 H Small: 43.8 (#227)

Writing & Preference benchmarks
BenchmarkGranite 4.1 8bGranite 4.0 H Small
LMArena Text12901241
LMArena Creative Writing12511211
LMArena Multi-Turn12681242
WildBench—73.9%

Frequently asked questions

Is Granite 4.1 8b better than Granite 4.0 H Small?

Granite 4.1 8b and Granite 4.0 H Small score almost the same on the Noometry Index (37.4 vs 36.5), so choose on price, context window or the category you care about most.

Is Granite 4.1 8b or Granite 4.0 H Small better for coding?

Granite 4.0 H Small scores higher on coding benchmarks: 36.4 versus 30.1 in the Noometry coding category.

How many benchmarks do Granite 4.1 8b and Granite 4.0 H Small share?

12 benchmarks have published results for both models. Granite 4.1 8b has 13 scored results on Noometry and Granite 4.0 H Small has 19.

Related comparisons

Go deeper