Model comparison

Granite 4.0 H Small vs Mercury

Mercury is the stronger model overall, scoring 37.6 to 36.5 on the Noometry Index.

Last verified . 8 shared benchmarks.

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Mercury Inception

37.6

Rank #199 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Granite 4.0 H Small scores higher in 2 categories and Mercury in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Granite 4.0 H Small leads 24.4 to 17.5.
  • Granite 4.0 H Small has downloadable open weights; the other is API-only.

Side by side

Granite 4.0 H Small and Mercury specifications
Granite 4.0 H SmallMercury
ProviderIBMInception
Noometry Index36.537.6
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked199

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mercury leads

Granite 4.0 H Small: 36.4 (#209), Mercury: 38.7 (#170)

Coding benchmarks
BenchmarkGranite 4.0 H SmallMercury
LMArena Coding12491322

Reasoning Granite 4.0 H Small leads

Granite 4.0 H Small: 24.4 (#163), Mercury: 17.5 (#293)

Reasoning benchmarks
BenchmarkGranite 4.0 H SmallMercury
LMArena Hard Prompts12401285
Kagi LLM Benchmark—21.6%

Math Not comparable

Granite 4.0 H Small: 31.4 (#223), Mercury: —

Math benchmarks
BenchmarkGranite 4.0 H SmallMercury
Omni-MATH29.6%—
LMArena Math1247—

Knowledge Not comparable

Granite 4.0 H Small: 32.0 (#215), Mercury: —

Knowledge benchmarks
BenchmarkGranite 4.0 H SmallMercury
MMLU-Pro56.9%—
Vectara Hallucination Rate5.2%—
GPQA (HELM)38.3%—
LMArena Expert1251—

Multilingual Mercury leads

Granite 4.0 H Small: 38.6 (#228), Mercury: 41.6 (#206)

Multilingual benchmarks
BenchmarkGranite 4.0 H SmallMercury
LMArena Non-English12161260
LMArena Chinese1249—
LMArena Russian1201—
LMArena Spanish1258—

Instruction Following Granite 4.0 H Small leads

Granite 4.0 H Small: 68.7 (#183), Mercury: 65.2 (#224)

Instruction Following benchmarks
BenchmarkGranite 4.0 H SmallMercury
LMArena Instruction Following12221239
IFEval89%—

Long Context Too close to call

Granite 4.0 H Small: 37.7 (#213), Mercury: 38.4 (#198)

Long Context benchmarks
BenchmarkGranite 4.0 H SmallMercury
LMArena Longer Query12421266

Writing & Preference Mercury leads

Granite 4.0 H Small: 43.8 (#227), Mercury: 46.2 (#221)

Writing & Preference benchmarks
BenchmarkGranite 4.0 H SmallMercury
LMArena Text12411282
LMArena Creative Writing12111191
LMArena Multi-Turn12421282
WildBench73.9%—

Frequently asked questions

Is Granite 4.0 H Small better than Mercury?

Mercury is the stronger model overall, scoring 37.6 to 36.5 on the Noometry Index.

Is Granite 4.0 H Small or Mercury better for coding?

Mercury scores higher on coding benchmarks: 38.7 versus 36.4 in the Noometry coding category.

How many benchmarks do Granite 4.0 H Small and Mercury share?

8 benchmarks have published results for both models. Granite 4.0 H Small has 19 scored results on Noometry and Mercury has 9.

Related comparisons

Go deeper