Noometry

Model comparison

Amazon Nova Pro vs Mistral Large 4

Mistral Large 4 is the stronger model overall, scoring 43.1 to 31.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Mistral Large 4 Mistral AI

43.1

Rank #99 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Pro scores higher in 0 categories and Mistral Large 4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Large 4 leads 60.4 to 43.9.
  • Mistral Large 4 is cheaper at $0.68 / $2.09 per million input/output tokens, against $0.80 / $3.20 for Amazon Nova Pro.
  • Mistral Large 4 accepts more context: 1.05M tokens versus 300K.

Side by side

Amazon Nova ProMistral Large 4
ProviderAmazonMistral AI
Noometry Index31.043.1
Released2024-12-032026-10-06
WeightsProprietaryProprietary
Context window300K1.05M
Max output10K262K
Input $ / M tokens$0.80$0.68
Output $ / M tokens$3.20$2.09
Results tracked3815

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large 4 leads

Amazon Nova Pro: 35.1 (#229), Mistral Large 4: 48.6 (#57)

BenchmarkAmazon Nova ProMistral Large 4
LMArena Coding12701475
LMArena WebDev—1541
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Mistral Large 4: —

BenchmarkAmazon Nova ProMistral Large 4
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Mistral Large 4 leads

Amazon Nova Pro: 20.0 (#243), Mistral Large 4: 22.5 (#192)

BenchmarkAmazon Nova ProMistral Large 4
LMArena Hard Prompts12461444
NYT Connections (extended)—27.4%
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Mistral Large 4 leads

Amazon Nova Pro: 28.5 (#243), Mistral Large 4: 40.4 (#91)

BenchmarkAmazon Nova ProMistral Large 4
LMArena Math12521488
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge Mistral Large 4 leads

Amazon Nova Pro: 27.4 (#250), Mistral Large 4: 36.6 (#166)

BenchmarkAmazon Nova ProMistral Large 4
LMArena Expert12111447
Humanity's Last Exam4.4%—
SimpleQA Verified—20%
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Mistral Large 4: —

BenchmarkAmazon Nova ProMistral Large 4
LMArena Vision980—

Multilingual Mistral Large 4 leads

Amazon Nova Pro: 39.7 (#223), Mistral Large 4: 52.6 (#82)

BenchmarkAmazon Nova ProMistral Large 4
LMArena Non-English12341415
LMArena Chinese12441491
LMArena Russian12401414
LMArena French1271—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—
LMArena Spanish1182—

Instruction Following Mistral Large 4 leads

Amazon Nova Pro: 64.9 (#226), Mistral Large 4: 75.0 (#76)

BenchmarkAmazon Nova ProMistral Large 4
LMArena Instruction Following12351424
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Mistral Large 4 leads

Amazon Nova Pro: 38.1 (#205), Mistral Large 4: 43.6 (#89)

BenchmarkAmazon Nova ProMistral Large 4
LMArena Longer Query12551429

Writing & Preference Mistral Large 4 leads

Amazon Nova Pro: 43.9 (#226), Mistral Large 4: 60.4 (#97)

BenchmarkAmazon Nova ProMistral Large 4
LMArena Text12591427
LMArena Creative Writing12121361
LMArena Multi-Turn12461424
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Mistral Large 4?

Mistral Large 4 is the stronger model overall, scoring 43.1 to 31.0 on the Noometry Index.

Which is cheaper, Amazon Nova Pro or Mistral Large 4?

Mistral Large 4 is cheaper. It lists at $0.68 per million input tokens and $2.09 per million output tokens; Amazon Nova Pro lists at $0.80 and $3.20.

Is Amazon Nova Pro or Mistral Large 4 better for coding?

Mistral Large 4 scores higher on coding benchmarks: 48.6 versus 35.1 in the Noometry coding category.

Which has the bigger context window?

Mistral Large 4 does, with 1.05M tokens against 300K.

How many benchmarks do Amazon Nova Pro and Mistral Large 4 share?

12 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Mistral Large 4 has 15.

Related comparisons

Go deeper