Model comparison

Granite 4.0 H Small vs Mistral Medium 3

Granite 4.0 H Small has enough public results to be ranked (#214); Mistral Medium 3 does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Mistral Medium 3 Mistral AI

37.0

Unranked Sparse

Summary

  • Granite 4.0 H Small has downloadable open weights; the other is API-only.

Side by side

Granite 4.0 H Small and Mistral Medium 3 specifications
Granite 4.0 H SmallMistral Medium 3
ProviderIBMMistral AI
Noometry Index36.537.0
Released—2025-05-07
WeightsOpenProprietary
Context window—131K
Max output—131K
Input $ / M tokens—$0.40
Output $ / M tokens—$2
Results tracked192

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 4.0 H Small: 36.4 (#209), Mistral Medium 3: —

Coding benchmarks
BenchmarkGranite 4.0 H SmallMistral Medium 3
LMArena Coding1249—

Reasoning Not comparable

Granite 4.0 H Small: 24.4 (#163), Mistral Medium 3: —

Reasoning benchmarks
BenchmarkGranite 4.0 H SmallMistral Medium 3
LMArena Hard Prompts1240—
Epoch Capabilities Index—134.07

Math Not comparable

Granite 4.0 H Small: 31.4 (#223), Mistral Medium 3: —

Math benchmarks
BenchmarkGranite 4.0 H SmallMistral Medium 3
Omni-MATH29.6%—
LMArena Math1247—

Knowledge Mistral Medium 3 leads

Granite 4.0 H Small: 32.0 (#215), Mistral Medium 3: 34.6

Knowledge benchmarks
BenchmarkGranite 4.0 H SmallMistral Medium 3
MMLU-Pro56.9%—
Confabulations—21.9%
Vectara Hallucination Rate5.2%—
GPQA (HELM)38.3%—
LMArena Expert1251—

Multilingual Not comparable

Granite 4.0 H Small: 38.6 (#228), Mistral Medium 3: —

Multilingual benchmarks
BenchmarkGranite 4.0 H SmallMistral Medium 3
LMArena Non-English1216—
LMArena Chinese1249—
LMArena Russian1201—
LMArena Spanish1258—

Instruction Following Not comparable

Granite 4.0 H Small: 68.7 (#183), Mistral Medium 3: —

Instruction Following benchmarks
BenchmarkGranite 4.0 H SmallMistral Medium 3
IFEval89%—
LMArena Instruction Following1222—

Long Context Not comparable

Granite 4.0 H Small: 37.7 (#213), Mistral Medium 3: —

Long Context benchmarks
BenchmarkGranite 4.0 H SmallMistral Medium 3
LMArena Longer Query1242—

Writing & Preference Not comparable

Granite 4.0 H Small: 43.8 (#227), Mistral Medium 3: —

Writing & Preference benchmarks
BenchmarkGranite 4.0 H SmallMistral Medium 3
LMArena Text1241—
LMArena Creative Writing1211—
WildBench73.9%—
LMArena Multi-Turn1242—

Frequently asked questions

Is Granite 4.0 H Small better than Mistral Medium 3?

Granite 4.0 H Small has enough public results to be ranked (#214); Mistral Medium 3 does not yet, so treat this comparison as directional.

How many benchmarks do Granite 4.0 H Small and Mistral Medium 3 share?

0 benchmarks have published results for both models. Granite 4.0 H Small has 19 scored results on Noometry and Mistral Medium 3 has 2.

Related comparisons

Go deeper