Model comparison

Mistral Large vs Nova 2.0 Pro Preview

Nova 2.0 Pro Preview is the stronger model overall, scoring 33.4 to 31.9 on the Noometry Index.

Last verified . 2 shared benchmarks.

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Nova 2.0 Pro Preview Amazon

33.4

Rank #244 Reported

Summary

  • They share 2 benchmarks with published results for both. Mistral Large scores higher in 1 category and Nova 2.0 Pro Preview in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Nova 2.0 Pro Preview leads 22.4 to 15.8.
  • The biggest single-benchmark swing is SciCode: 36.2% for Mistral Large and 42.7% for Nova 2.0 Pro Preview.
  • Mistral Large has downloadable open weights; the other is API-only.

Side by side

Mistral Large and Nova 2.0 Pro Preview specifications
Mistral LargeNova 2.0 Pro Preview
ProviderMistral AIAmazon
Noometry Index31.933.4
Released2024-02-262025-12-02
WeightsOpenProprietary
Context window131K—
Max output16K—
Input $ / M tokens$2—
Output $ / M tokens$6—
Results tracked513

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2.0 Pro Preview leads

Mistral Large: 34.3 (#240), Nova 2.0 Pro Preview: 40.8 (#133)

Coding benchmarks
BenchmarkMistral LargeNova 2.0 Pro Preview
SciCode36.2%42.7%
BigCodeBench Instruct30%—
LiveBench Coding47.1%—
LMArena Coding1277—
BigCodeBench Complete38.3%—
ALE-Bench264.7—
HumanEval+62.2%—
MBPP+59.5%—

Agentic & Tool Use Mistral Large leads

Mistral Large: 28.6 (#89), Nova 2.0 Pro Preview: 21.9 (#136)

Agentic & Tool Use benchmarks
BenchmarkMistral LargeNova 2.0 Pro Preview
Berkeley Function Calling Leaderboard38.4%—
GDP.pdf—2%

Reasoning Nova 2.0 Pro Preview leads

Mistral Large: 15.8 (#310), Nova 2.0 Pro Preview: 22.4 (#194)

Reasoning benchmarks
BenchmarkMistral LargeNova 2.0 Pro Preview
CritPt0%0%
SimpleBench22.5%—
LiveBench Reasoning43.5%—
LMArena Hard Prompts1257—
DTBench65.1%—
LiveBench Data Analysis50.1%—
LMCA16.7%—
Epoch Capabilities Index128.52—
ForecastBench57.1—
LiveBench48.4%—

Math Not comparable

Mistral Large: 18.2 (#291), Nova 2.0 Pro Preview: —

Math benchmarks
BenchmarkMistral LargeNova 2.0 Pro Preview
OTIS Mock AIME 2024-20258.5%—
Omni-MATH28.1%—
LiveBench Math42.5%—
LMArena Math1262—
MATH Level 550.3%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Not comparable

Mistral Large: 30.1 (#230), Nova 2.0 Pro Preview: —

Knowledge benchmarks
BenchmarkMistral LargeNova 2.0 Pro Preview
GPQA Diamond51.3%—
MMLU-Pro59.9%—
Confabulations21.4%—
Vectara Hallucination Rate4.5%—
GPQA (HELM)43.5%—
LMArena Expert1232—
MMLU80%—

Multilingual Not comparable

Mistral Large: 40.0 (#219), Nova 2.0 Pro Preview: —

Multilingual benchmarks
BenchmarkMistral LargeNova 2.0 Pro Preview
LMArena Non-English1237—
LMArena Chinese1240—
LMArena French1325—
LMArena German1254—
LMArena Japanese1188—
LMArena Korean1202—
LMArena Russian1257—
LMArena Spanish1268—

Instruction Following Not comparable

Mistral Large: 67.9 (#191), Nova 2.0 Pro Preview: —

Instruction Following benchmarks
BenchmarkMistral LargeNova 2.0 Pro Preview
LiveBench Instruction Following67.9%—
IFEval87.7%—
LMArena Instruction Following1249—

Long Context Not comparable

Mistral Large: 38.3 (#199), Nova 2.0 Pro Preview: —

Long Context benchmarks
BenchmarkMistral LargeNova 2.0 Pro Preview
LMArena Longer Query1261—

Writing & Preference Not comparable

Mistral Large: 40.7 (#242), Nova 2.0 Pro Preview: —

Writing & Preference benchmarks
BenchmarkMistral LargeNova 2.0 Pro Preview
LMArena Text1266—
LMArena Creative Writing1243—
Short-Story Creative Writing69%—
EQ-Bench Creative Writing985—
WildBench80.1%—
LMArena Multi-Turn1260—
LiveBench Language39.4%—

Frequently asked questions

Is Mistral Large better than Nova 2.0 Pro Preview?

Nova 2.0 Pro Preview is the stronger model overall, scoring 33.4 to 31.9 on the Noometry Index.

Is Mistral Large or Nova 2.0 Pro Preview better for coding?

Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.8 versus 34.3 in the Noometry coding category.

How many benchmarks do Mistral Large and Nova 2.0 Pro Preview share?

2 benchmarks have published results for both models. Mistral Large has 51 scored results on Noometry and Nova 2.0 Pro Preview has 3.

Related comparisons

Go deeper