Model comparison

Amazon Nova Experimental Chat 26 02 10 vs Mistral Medium 3.5

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 43.8 to 39.6 on the Noometry Index.

Last verified . 12 shared benchmarks.

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 26 02 10 scores higher in 8 categories and Mistral Medium 3.5 in 0 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Amazon Nova Experimental Chat 26 02 10 leads 28.9 to 16.6.
  • Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 26 02 10 and Mistral Medium 3.5 specifications
Amazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
ProviderAmazonMistral AI
Noometry Index43.839.6
Released——
WeightsProprietaryOpen
Context window—262K
Max output—210K
Input $ / M tokens—$1.50
Output $ / M tokens—$7.50
Results tracked1222

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 43.2 (#81), Mistral Medium 3.5: 35.7 (#208)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
LMArena Coding14831461
LMArena WebDev—1263

Reasoning Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 28.9 (#84), Mistral Medium 3.5: 16.6 (#290)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
LMArena Hard Prompts14581436
Kagi LLM Benchmark—41.4%
NYT Connections (extended)—12.9%
Epoch Capabilities Index—141.42

Math Too close to call

Amazon Nova Experimental Chat 26 02 10: 36.6 (#108), Mistral Medium 3.5: 36.4 (#113)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
LMArena Math14401432

Knowledge Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 41.6 (#98), Mistral Medium 3.5: 39.3 (#123)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
LMArena Expert15051431

Multimodal Not comparable

Amazon Nova Experimental Chat 26 02 10: —, Mistral Medium 3.5: 37.6 (#64)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
LMArena Vision—1222

Multilingual Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 54.3 (#48), Mistral Medium 3.5: 52.1 (#93)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
LMArena Non-English14351405
LMArena Chinese14651443
LMArena Russian14231396
LMArena French—1448
LMArena German—1453
LMArena Korean—1387
LMArena Spanish—1406

Instruction Following Too close to call

Amazon Nova Experimental Chat 26 02 10: 75.3 (#66), Mistral Medium 3.5: 74.7 (#87)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
LMArena Instruction Following14261414

Long Context Too close to call

Amazon Nova Experimental Chat 26 02 10: 44.0 (#73), Mistral Medium 3.5: 43.2 (#101)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
LMArena Longer Query14411414

Writing & Preference Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 62.0 (#80), Mistral Medium 3.5: 58.6 (#113)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral Medium 3.5
LMArena Text14491421
LMArena Creative Writing13691372
LMArena Multi-Turn14421423
EQ-Bench 4—993

Frequently asked questions

Is Amazon Nova Experimental Chat 26 02 10 better than Mistral Medium 3.5?

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 43.8 to 39.6 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 02 10 or Mistral Medium 3.5 better for coding?

Amazon Nova Experimental Chat 26 02 10 scores higher on coding benchmarks: 43.2 versus 35.7 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 02 10 and Mistral Medium 3.5 share?

12 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 02 10 has 12 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper