Model comparison

Amazon Nova Experimental Chat 10 20 vs Granite 4.0 H Small

Amazon Nova Experimental Chat 10 20 is the stronger model overall, scoring 42.1 to 36.5 on the Noometry Index.

Last verified . 13 shared benchmarks.

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Amazon Nova Experimental Chat 10 20 scores higher in 8 categories and Granite 4.0 H Small in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 10 20 leads 56.6 to 43.8.
  • Granite 4.0 H Small has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 10 20 and Granite 4.0 H Small specifications
Amazon Nova Experimental Chat 10 20Granite 4.0 H Small
ProviderAmazonIBM
Noometry Index42.136.5
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 41.6 (#123), Granite 4.0 H Small: 36.4 (#209)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Granite 4.0 H Small
LMArena Coding14121249

Reasoning Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 28.4 (#106), Granite 4.0 H Small: 24.4 (#163)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Granite 4.0 H Small
LMArena Hard Prompts13961240

Math Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 39.0 (#119), Granite 4.0 H Small: 31.4 (#223)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Granite 4.0 H Small
LMArena Math14251247
Omni-MATH—29.6%

Knowledge Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 38.5 (#144), Granite 4.0 H Small: 32.0 (#215)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Granite 4.0 H Small
LMArena Expert13861251
MMLU-Pro—56.9%
Vectara Hallucination Rate—5.2%
GPQA (HELM)—38.3%

Multilingual Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 49.5 (#131), Granite 4.0 H Small: 38.6 (#228)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Granite 4.0 H Small
LMArena Non-English13721216
LMArena Chinese14041249
LMArena Russian13711201
LMArena Spanish13821258
LMArena French1425—
LMArena German1391—
LMArena Japanese1360—
LMArena Korean1324—

Instruction Following Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 72.1 (#141), Granite 4.0 H Small: 68.7 (#183)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Granite 4.0 H Small
LMArena Instruction Following13651222
IFEval—89%

Long Context Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 41.7 (#133), Granite 4.0 H Small: 37.7 (#213)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Granite 4.0 H Small
LMArena Longer Query13701242

Writing & Preference Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 56.6 (#136), Granite 4.0 H Small: 43.8 (#227)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Granite 4.0 H Small
LMArena Text13941241
LMArena Creative Writing13181211
LMArena Multi-Turn13641242
WildBench—73.9%

Frequently asked questions

Is Amazon Nova Experimental Chat 10 20 better than Granite 4.0 H Small?

Amazon Nova Experimental Chat 10 20 is the stronger model overall, scoring 42.1 to 36.5 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 20 or Granite 4.0 H Small better for coding?

Amazon Nova Experimental Chat 10 20 scores higher on coding benchmarks: 41.6 versus 36.4 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 20 and Granite 4.0 H Small share?

13 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 20 has 17 scored results on Noometry and Granite 4.0 H Small has 19.

Related comparisons

Go deeper