Model comparison

Granite 4.0 H Small vs Mistral

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 29.9 on the Noometry Index.

Last verified . 18 shared benchmarks.

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Mistral Mistral AI

29.9

Rank #303 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Granite 4.0 H Small scores higher in 8 categories and Mistral in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where Granite 4.0 H Small leads 68.7 to 52.6.
  • The biggest single-benchmark swing is IFEval: 89% for Granite 4.0 H Small and 56.8% for Mistral.
  • Granite 4.0 H Small has downloadable open weights; the other is API-only.

Side by side

Granite 4.0 H Small and Mistral specifications
Granite 4.0 H SmallMistral
ProviderIBMMistral AI
Noometry Index36.529.9
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1922

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.0 H Small leads

Granite 4.0 H Small: 36.4 (#209), Mistral: 33.8 (#250)

Coding benchmarks
BenchmarkGranite 4.0 H SmallMistral
LMArena Coding12491162

Reasoning Granite 4.0 H Small leads

Granite 4.0 H Small: 24.4 (#163), Mistral: 22.2 (#200)

Reasoning benchmarks
BenchmarkGranite 4.0 H SmallMistral
LMArena Hard Prompts12401149

Math Granite 4.0 H Small leads

Granite 4.0 H Small: 31.4 (#223), Mistral: 22.3 (#278)

Math benchmarks
BenchmarkGranite 4.0 H SmallMistral
Omni-MATH29.6%7.2%
LMArena Math12471180

Knowledge Granite 4.0 H Small leads

Granite 4.0 H Small: 32.0 (#215), Mistral: 16.6 (#288)

Knowledge benchmarks
BenchmarkGranite 4.0 H SmallMistral
MMLU-Pro56.9%27.7%
GPQA (HELM)38.3%30.3%
LMArena Expert12511125
Vectara Hallucination Rate5.2%—

Multilingual Granite 4.0 H Small leads

Granite 4.0 H Small: 38.6 (#228), Mistral: 32.8 (#254)

Multilingual benchmarks
BenchmarkGranite 4.0 H SmallMistral
LMArena Non-English12161129
LMArena Chinese12491109
LMArena Russian12011168
LMArena Spanish12581143
LMArena French—1180
LMArena German—1155
LMArena Japanese—1013
LMArena Korean—1032

Instruction Following Granite 4.0 H Small leads

Granite 4.0 H Small: 68.7 (#183), Mistral: 52.6 (#288)

Instruction Following benchmarks
BenchmarkGranite 4.0 H SmallMistral
IFEval89%56.8%
LMArena Instruction Following12221152

Long Context Granite 4.0 H Small leads

Granite 4.0 H Small: 37.7 (#213), Mistral: 35.0 (#245)

Long Context benchmarks
BenchmarkGranite 4.0 H SmallMistral
LMArena Longer Query12421153

Writing & Preference Granite 4.0 H Small leads

Granite 4.0 H Small: 43.8 (#227), Mistral: 37.0 (#260)

Writing & Preference benchmarks
BenchmarkGranite 4.0 H SmallMistral
LMArena Text12411165
LMArena Creative Writing12111158
WildBench73.9%66%
LMArena Multi-Turn12421147

Frequently asked questions

Is Granite 4.0 H Small better than Mistral?

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 29.9 on the Noometry Index.

Is Granite 4.0 H Small or Mistral better for coding?

Granite 4.0 H Small scores higher on coding benchmarks: 36.4 versus 33.8 in the Noometry coding category.

How many benchmarks do Granite 4.0 H Small and Mistral share?

18 benchmarks have published results for both models. Granite 4.0 H Small has 19 scored results on Noometry and Mistral has 22.

Related comparisons

Go deeper