Model comparison

Amazon Nova Experimental Chat 10 09 vs Olmo 3.1 32b Instruct

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.4 to 38.8 on the Noometry Index.

Last verified . 9 shared benchmarks.

Summary

  • They share 9 benchmarks with published results for both. Amazon Nova Experimental Chat 10 09 scores higher in 6 categories and Olmo 3.1 32b Instruct in 0 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Amazon Nova Experimental Chat 10 09 leads 47.5 to 42.8.
  • Olmo 3.1 32b Instruct has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 10 09 and Olmo 3.1 32b Instruct specifications
Amazon Nova Experimental Chat 10 09Olmo 3.1 32b Instruct
ProviderAmazonAllen Institute for AI (Ai2)
Noometry Index41.438.8
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked916

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Experimental Chat 10 09: 39.6 (#142), Olmo 3.1 32b Instruct: 38.9 (#154)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Olmo 3.1 32b Instruct
LMArena Coding13711346

Reasoning Too close to call

Amazon Nova Experimental Chat 10 09: 26.2 (#122), Olmo 3.1 32b Instruct: 25.4 (#131)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Olmo 3.1 32b Instruct
LMArena Hard Prompts13561322

Math Not comparable

Amazon Nova Experimental Chat 10 09: —, Olmo 3.1 32b Instruct: 33.6 (#169)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Olmo 3.1 32b Instruct
LMArena Math—1305

Knowledge Not comparable

Amazon Nova Experimental Chat 10 09: —, Olmo 3.1 32b Instruct: 35.4 (#175)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Olmo 3.1 32b Instruct
LMArena Expert—1307

Multilingual Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 47.5 (#145), Olmo 3.1 32b Instruct: 42.8 (#185)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Olmo 3.1 32b Instruct
LMArena Non-English13411275
LMArena Chinese13451304
LMArena French—1328
LMArena German—1283
LMArena Korean—1206
LMArena Russian—1268
LMArena Spanish—1337

Instruction Following Too close to call

Amazon Nova Experimental Chat 10 09: 69.7 (#167), Olmo 3.1 32b Instruct: 68.8 (#182)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Olmo 3.1 32b Instruct
LMArena Instruction Following13161298

Long Context Too close to call

Amazon Nova Experimental Chat 10 09: 40.6 (#146), Olmo 3.1 32b Instruct: 39.9 (#161)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Olmo 3.1 32b Instruct
LMArena Longer Query13341312

Writing & Preference Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 55.0 (#144), Olmo 3.1 32b Instruct: 50.4 (#179)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Olmo 3.1 32b Instruct
LMArena Text13651311
LMArena Creative Writing13071264
LMArena Multi-Turn13541309

Frequently asked questions

Is Amazon Nova Experimental Chat 10 09 better than Olmo 3.1 32b Instruct?

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.4 to 38.8 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 09 or Olmo 3.1 32b Instruct better for coding?

They score almost the same on coding (39.6 vs 38.9); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Experimental Chat 10 09 and Olmo 3.1 32b Instruct share?

9 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 09 has 9 scored results on Noometry and Olmo 3.1 32b Instruct has 16.

Related comparisons

Go deeper