Model comparison

Amazon Nova Experimental Chat 26 02 10 vs Mistral

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 44.5 to 29.9 on the Noometry Index.

Last verified . 12 shared benchmarks.

Mistral Mistral AI

29.9

Rank #303 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 26 02 10 scores higher in 8 categories and Mistral in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Amazon Nova Experimental Chat 26 02 10 leads 42.3 to 16.6.

Side by side

Amazon Nova Experimental Chat 26 02 10 and Mistral specifications
Amazon Nova Experimental Chat 26 02 10Mistral
ProviderAmazonMistral AI
Noometry Index44.529.9
Released——
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1222

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 43.9 (#82), Mistral: 33.8 (#250)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral
LMArena Coding14831162

Reasoning Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 30.1 (#86), Mistral: 22.2 (#200)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral
LMArena Hard Prompts14581149

Math Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 39.3 (#109), Mistral: 22.3 (#278)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral
LMArena Math14381180
Omni-MATH—7.2%

Knowledge Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 42.3 (#97), Mistral: 16.6 (#288)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral
LMArena Expert15061125
MMLU-Pro—27.7%
GPQA (HELM)—30.3%

Multilingual Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 54.0 (#50), Mistral: 32.8 (#254)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral
LMArena Non-English14341129
LMArena Chinese14631109
LMArena Russian14231168
LMArena French—1180
LMArena German—1155
LMArena Japanese—1013
LMArena Korean—1032
LMArena Spanish—1143

Instruction Following Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 75.2 (#69), Mistral: 52.6 (#288)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral
LMArena Instruction Following14271152
IFEval—56.8%

Long Context Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 44.0 (#77), Mistral: 35.0 (#245)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral
LMArena Longer Query14411153

Writing & Preference Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 61.8 (#84), Mistral: 37.0 (#260)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Mistral
LMArena Text14481165
LMArena Creative Writing13681158
LMArena Multi-Turn14421147
WildBench—66%

Frequently asked questions

Is Amazon Nova Experimental Chat 26 02 10 better than Mistral?

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 44.5 to 29.9 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 02 10 or Mistral better for coding?

Amazon Nova Experimental Chat 26 02 10 scores higher on coding benchmarks: 43.9 versus 33.8 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 02 10 and Mistral share?

12 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 02 10 has 12 scored results on Noometry and Mistral has 22.

Related comparisons

Go deeper