Noometry

Model comparison

Amazon Nova Pro vs Granite 4.1 8b

Granite 4.1 8b is the stronger model overall, scoring 37.4 to 31.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Granite 4.1 8b IBM

37.4

Rank #205 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Pro scores higher in 1 category and Granite 4.1 8b in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.1 8b leads 36.1 to 27.4.
  • Granite 4.1 8b has downloadable open weights; the other is API-only.

Side by side

Amazon Nova ProGranite 4.1 8b
ProviderAmazonIBM
Noometry Index31.037.4
Released2024-12-03—
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3813

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Pro leads

Amazon Nova Pro: 35.1 (#229), Granite 4.1 8b: 30.1 (#297)

BenchmarkAmazon Nova ProGranite 4.1 8b
LMArena Coding12701312
LMArena WebDev—1192
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Granite 4.1 8b: —

BenchmarkAmazon Nova ProGranite 4.1 8b
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Granite 4.1 8b leads

Amazon Nova Pro: 20.0 (#243), Granite 4.1 8b: 25.7 (#143)

BenchmarkAmazon Nova ProGranite 4.1 8b
LMArena Hard Prompts12461293
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Granite 4.1 8b leads

Amazon Nova Pro: 28.5 (#243), Granite 4.1 8b: 36.4 (#166)

BenchmarkAmazon Nova ProGranite 4.1 8b
LMArena Math12521312
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge Granite 4.1 8b leads

Amazon Nova Pro: 27.4 (#250), Granite 4.1 8b: 36.1 (#174)

BenchmarkAmazon Nova ProGranite 4.1 8b
LMArena Expert12111309
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Granite 4.1 8b: —

BenchmarkAmazon Nova ProGranite 4.1 8b
LMArena Vision980—

Multilingual Granite 4.1 8b leads

Amazon Nova Pro: 39.7 (#223), Granite 4.1 8b: 41.7 (#204)

BenchmarkAmazon Nova ProGranite 4.1 8b
LMArena Non-English12341261
LMArena Chinese12441337
LMArena Russian12401240
LMArena French1271—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—
LMArena Spanish1182—

Instruction Following Granite 4.1 8b leads

Amazon Nova Pro: 64.9 (#226), Granite 4.1 8b: 66.9 (#203)

BenchmarkAmazon Nova ProGranite 4.1 8b
LMArena Instruction Following12351269
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Too close to call

Amazon Nova Pro: 38.1 (#205), Granite 4.1 8b: 38.7 (#193)

BenchmarkAmazon Nova ProGranite 4.1 8b
LMArena Longer Query12551275

Writing & Preference Granite 4.1 8b leads

Amazon Nova Pro: 43.9 (#226), Granite 4.1 8b: 48.1 (#204)

BenchmarkAmazon Nova ProGranite 4.1 8b
LMArena Text12591290
LMArena Creative Writing12121251
LMArena Multi-Turn12461268
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Granite 4.1 8b?

Granite 4.1 8b is the stronger model overall, scoring 37.4 to 31.0 on the Noometry Index.

Is Amazon Nova Pro or Granite 4.1 8b better for coding?

Amazon Nova Pro scores higher on coding benchmarks: 35.1 versus 30.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Pro and Granite 4.1 8b share?

12 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Granite 4.1 8b has 13.

Related comparisons

Go deeper