Noometry

Model comparison

Amazon Nova Pro vs Granite 4.0 H Small

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 31.0 on the Noometry Index.

Last verified . 19 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Amazon Nova Pro scores higher in 3 categories and Granite 4.0 H Small in 5 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.0 H Small leads 32.0 to 27.4.
  • The biggest single-benchmark swing is MMLU-Pro: 67.3% for Amazon Nova Pro and 56.9% for Granite 4.0 H Small.
  • Granite 4.0 H Small has downloadable open weights; the other is API-only.

Side by side

Amazon Nova ProGranite 4.0 H Small
ProviderAmazonIBM
Noometry Index31.036.5
Released2024-12-03—
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3819

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.0 H Small leads

Amazon Nova Pro: 35.1 (#229), Granite 4.0 H Small: 36.4 (#209)

BenchmarkAmazon Nova ProGranite 4.0 H Small
LMArena Coding12701249
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Granite 4.0 H Small: —

BenchmarkAmazon Nova ProGranite 4.0 H Small
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Granite 4.0 H Small leads

Amazon Nova Pro: 20.0 (#243), Granite 4.0 H Small: 24.4 (#163)

BenchmarkAmazon Nova ProGranite 4.0 H Small
LMArena Hard Prompts12461240
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Granite 4.0 H Small leads

Amazon Nova Pro: 28.5 (#243), Granite 4.0 H Small: 31.4 (#223)

BenchmarkAmazon Nova ProGranite 4.0 H Small
Omni-MATH24.2%29.6%
LMArena Math12521247
LiveBench Math38%—

Knowledge Granite 4.0 H Small leads

Amazon Nova Pro: 27.4 (#250), Granite 4.0 H Small: 32.0 (#215)

BenchmarkAmazon Nova ProGranite 4.0 H Small
MMLU-Pro67.3%56.9%
Vectara Hallucination Rate5.1%5.2%
GPQA (HELM)44.6%38.3%
LMArena Expert12111251
Humanity's Last Exam4.4%—
Confabulations30.1%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Granite 4.0 H Small: —

BenchmarkAmazon Nova ProGranite 4.0 H Small
LMArena Vision980—

Multilingual Amazon Nova Pro leads

Amazon Nova Pro: 39.7 (#223), Granite 4.0 H Small: 38.6 (#228)

BenchmarkAmazon Nova ProGranite 4.0 H Small
LMArena Non-English12341216
LMArena Chinese12441249
LMArena Russian12401201
LMArena Spanish11821258
LMArena French1271—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—

Instruction Following Granite 4.0 H Small leads

Amazon Nova Pro: 64.9 (#226), Granite 4.0 H Small: 68.7 (#183)

BenchmarkAmazon Nova ProGranite 4.0 H Small
IFEval81.5%89%
LMArena Instruction Following12351222
LiveBench Instruction Following67.1%—

Long Context Too close to call

Amazon Nova Pro: 38.1 (#205), Granite 4.0 H Small: 37.7 (#213)

BenchmarkAmazon Nova ProGranite 4.0 H Small
LMArena Longer Query12551242

Writing & Preference Too close to call

Amazon Nova Pro: 43.9 (#226), Granite 4.0 H Small: 43.8 (#227)

BenchmarkAmazon Nova ProGranite 4.0 H Small
LMArena Text12591241
LMArena Creative Writing12121211
WildBench77.7%73.9%
LMArena Multi-Turn12461242
Short-Story Creative Writing60.5%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Granite 4.0 H Small?

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 31.0 on the Noometry Index.

Is Amazon Nova Pro or Granite 4.0 H Small better for coding?

Granite 4.0 H Small scores higher on coding benchmarks: 36.4 versus 35.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Pro and Granite 4.0 H Small share?

19 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Granite 4.0 H Small has 19.

Related comparisons

Go deeper