Model comparison

Amazon Nova Experimental Chat 10 09 vs Mistral

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 29.9 on the Noometry Index.

Last verified . 9 shared benchmarks.

Mistral Mistral AI

29.9

Rank #303 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Amazon Nova Experimental Chat 10 09 scores higher in 6 categories and Mistral in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 10 09 leads 54.7 to 37.0.

Side by side

Amazon Nova Experimental Chat 10 09 and Mistral specifications
Amazon Nova Experimental Chat 10 09Mistral
ProviderAmazonMistral AI
Noometry Index41.929.9
Released——
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked922

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 40.2 (#145), Mistral: 33.8 (#250)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Mistral
LMArena Coding13701162

Reasoning Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 27.3 (#120), Mistral: 22.2 (#200)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Mistral
LMArena Hard Prompts13561149

Math Not comparable

Amazon Nova Experimental Chat 10 09: —, Mistral: 22.3 (#278)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Mistral
Omni-MATH—7.2%
LMArena Math—1180

Knowledge Not comparable

Amazon Nova Experimental Chat 10 09: —, Mistral: 16.6 (#288)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Mistral
MMLU-Pro—27.7%
GPQA (HELM)—30.3%
LMArena Expert—1125

Multilingual Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 47.3 (#150), Mistral: 32.8 (#254)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Mistral
LMArena Non-English13401129
LMArena Chinese13411109
LMArena French—1180
LMArena German—1155
LMArena Japanese—1013
LMArena Korean—1032
LMArena Russian—1168
LMArena Spanish—1143

Instruction Following Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 69.4 (#172), Mistral: 52.6 (#288)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Mistral
LMArena Instruction Following13151152
IFEval—56.8%

Long Context Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 40.5 (#152), Mistral: 35.0 (#245)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Mistral
LMArena Longer Query13331153

Writing & Preference Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 54.7 (#149), Mistral: 37.0 (#260)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Mistral
LMArena Text13641165
LMArena Creative Writing13071158
LMArena Multi-Turn13551147
WildBench—66%

Frequently asked questions

Is Amazon Nova Experimental Chat 10 09 better than Mistral?

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 29.9 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 09 or Mistral better for coding?

Amazon Nova Experimental Chat 10 09 scores higher on coding benchmarks: 40.2 versus 33.8 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 09 and Mistral share?

9 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 09 has 9 scored results on Noometry and Mistral has 22.

Related comparisons

Go deeper