Model comparison

Amazon Nova Experimental Chat 26 01 10 vs Granite 3.1 8b Instruct

Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 32.4 on the Noometry Index.

Last verified . 12 shared benchmarks.

Granite 3.1 8b Instruct IBM

32.4

Rank #258 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 26 01 10 scores higher in 8 categories and Granite 3.1 8b Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 26 01 10 leads 57.4 to 35.5.
  • Granite 3.1 8b Instruct has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 26 01 10 and Granite 3.1 8b Instruct specifications
Amazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
ProviderAmazonIBM
Noometry Index42.832.4
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1313

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 42.7 (#96), Granite 3.1 8b Instruct: 34.5 (#233)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
LMArena Coding14471186

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 26 01 10: —, Granite 3.1 8b Instruct: 24.1 (#120)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
Berkeley Function Calling Leaderboard—27.1%

Reasoning Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 28.9 (#98), Granite 3.1 8b Instruct: 22.1 (#207)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
LMArena Hard Prompts14151145

Math Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 38.5 (#136), Granite 3.1 8b Instruct: 33.0 (#209)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
LMArena Math14041152

Knowledge Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 40.3 (#120), Granite 3.1 8b Instruct: 31.1 (#220)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
LMArena Expert14441142

Multilingual Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 50.2 (#126), Granite 3.1 8b Instruct: 30.9 (#260)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
LMArena Non-English13811099
LMArena Chinese13721145
LMArena Russian13911092
LMArena Spanish1390—

Instruction Following Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 72.9 (#126), Granite 3.1 8b Instruct: 58.6 (#259)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
LMArena Instruction Following13811131

Long Context Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 42.7 (#119), Granite 3.1 8b Instruct: 35.2 (#241)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
LMArena Longer Query14001162

Writing & Preference Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 57.4 (#129), Granite 3.1 8b Instruct: 35.5 (#266)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Granite 3.1 8b Instruct
LMArena Text13961150
LMArena Creative Writing13311129
LMArena Multi-Turn13801108

Frequently asked questions

Is Amazon Nova Experimental Chat 26 01 10 better than Granite 3.1 8b Instruct?

Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 32.4 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 01 10 or Granite 3.1 8b Instruct better for coding?

Amazon Nova Experimental Chat 26 01 10 scores higher on coding benchmarks: 42.7 versus 34.5 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 01 10 and Granite 3.1 8b Instruct share?

12 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 01 10 has 13 scored results on Noometry and Granite 3.1 8b Instruct has 13.

Related comparisons

Go deeper