Model comparison

Amazon Nova Pro vs Mistral Medium 3.1

Amazon Nova Pro and Mistral Medium 3.1 score almost the same on the Noometry Index (31.0 vs 31.9), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Summary

  • The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 43.9.
  • Mistral Medium 3.1 is cheaper at $0.40 / $2 per million input/output tokens, against $0.80 / $3.20 for Amazon Nova Pro.
  • Amazon Nova Pro accepts more context: 300K tokens versus 131K.

Side by side

Amazon Nova Pro and Mistral Medium 3.1 specifications
Amazon Nova ProMistral Medium 3.1
ProviderAmazonMistral AI
Noometry Index31.031.9
Released2024-12-03—
WeightsProprietaryProprietary
Context window300K131K
Max output10K105K
Input $ / M tokens$0.80$0.40
Output $ / M tokens$3.20$2
Results tracked383

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Pro: 35.1 (#229), Mistral Medium 3.1: —

Coding benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
LiveBench Coding38.1%—
LMArena Coding1270—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Mistral Medium 3.1: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Amazon Nova Pro leads

Amazon Nova Pro: 20.0 (#243), Mistral Medium 3.1: 10.6 (#341)

Reasoning benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
NYT Connections (extended)—6.5%
Thematic Generalization—20.3%
LiveBench Reasoning32.6%—
LMArena Hard Prompts1246—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Not comparable

Amazon Nova Pro: 28.5 (#243), Mistral Medium 3.1: —

Math benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
Omni-MATH24.2%—
LiveBench Math38%—
LMArena Math1252—

Knowledge Not comparable

Amazon Nova Pro: 27.4 (#250), Mistral Medium 3.1: —

Knowledge benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
LMArena Expert1211—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Mistral Medium 3.1: —

Multimodal benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
LMArena Vision980—

Multilingual Not comparable

Amazon Nova Pro: 39.7 (#223), Mistral Medium 3.1: —

Multilingual benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
LMArena Non-English1234—
LMArena Chinese1244—
LMArena French1271—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—
LMArena Russian1240—
LMArena Spanish1182—

Instruction Following Not comparable

Amazon Nova Pro: 64.9 (#226), Mistral Medium 3.1: —

Instruction Following benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
LiveBench Instruction Following67.1%—
IFEval81.5%—
LMArena Instruction Following1235—

Long Context Not comparable

Amazon Nova Pro: 38.1 (#205), Mistral Medium 3.1: —

Long Context benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
LMArena Longer Query1255—

Writing & Preference Mistral Medium 3.1 leads

Amazon Nova Pro: 43.9 (#226), Mistral Medium 3.1: 55.5 (#145)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProMistral Medium 3.1
LMArena Text1259—
LMArena Creative Writing1212—
Short-Story Creative Writing60.5%—
EQ-Bench Creative Writing—1476
WildBench77.7%—
LMArena Multi-Turn1246—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Mistral Medium 3.1?

Amazon Nova Pro and Mistral Medium 3.1 score almost the same on the Noometry Index (31.0 vs 31.9), so choose on price, context window or the category you care about most.

Which is cheaper, Amazon Nova Pro or Mistral Medium 3.1?

Mistral Medium 3.1 is cheaper. It lists at $0.40 per million input tokens and $2 per million output tokens; Amazon Nova Pro lists at $0.80 and $3.20.

Which has the bigger context window?

Amazon Nova Pro does, with 300K tokens against 131K.

How many benchmarks do Amazon Nova Pro and Mistral Medium 3.1 share?

0 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Mistral Medium 3.1 has 3.

Related comparisons

Go deeper