Model comparison

Mistral Medium vs Nova 2.0 Pro Preview

Mistral Medium is the stronger model overall, scoring 36.3 to 33.4 on the Noometry Index.

Last verified . 2 shared benchmarks.

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Nova 2.0 Pro Preview Amazon

33.4

Rank #244 Reported

Summary

  • They share 2 benchmarks with published results for both. Mistral Medium scores higher in 2 categories and Nova 2.0 Pro Preview in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Nova 2.0 Pro Preview leads 40.8 to 34.2.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

Mistral Medium and Nova 2.0 Pro Preview specifications
Mistral MediumNova 2.0 Pro Preview
ProviderMistral AIAmazon
Noometry Index36.333.4
Released2023-12-112025-12-02
WeightsOpenProprietary
Context window262K—
Max output262K—
Input $ / M tokens$1.50—
Output $ / M tokens$7.50—
Results tracked363

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2.0 Pro Preview leads

Mistral Medium: 34.2 (#243), Nova 2.0 Pro Preview: 40.8 (#133)

Coding benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
SciCode40.2%42.7%
FrontierCode8%—
WeirdML43.7%—
LMArena Coding1434—
ALE-Bench763.98—

Agentic & Tool Use Mistral Medium leads

Mistral Medium: 28.3 (#90), Nova 2.0 Pro Preview: 21.9 (#136)

Agentic & Tool Use benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
Berkeley Function Calling Leaderboard37.7%—
GDP.pdf—2%

Reasoning Mistral Medium leads

Mistral Medium: 24.0 (#167), Nova 2.0 Pro Preview: 22.4 (#194)

Reasoning benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
CritPt0%0%
Kagi LLM Benchmark50%—
LMArena Hard Prompts1426—
DTBench75.5%—
LMCA26.1%—
Surface Evolver Bench26.9%—

Math Not comparable

Mistral Medium: 28.1 (#245), Nova 2.0 Pro Preview: —

Math benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
OTIS Mock AIME 2024-202532.2%—
ProofBench9%—
LMArena Math1408—
MATH Level 581.6%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Not comparable

Mistral Medium: 25.0 (#265), Nova 2.0 Pro Preview: —

Knowledge benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
GPQA Diamond59.5%—
Humanity's Last Exam4.5%—
Vectara Hallucination Rate22.7%—
LMArena Expert1408—

Multimodal Not comparable

Mistral Medium: 35.3 (#88), Nova 2.0 Pro Preview: —

Multimodal benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
LMArena Vision1172—

Multilingual Not comparable

Mistral Medium: 52.1 (#91), Nova 2.0 Pro Preview: —

Multilingual benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
LMArena Non-English1408—
LMArena Chinese1447—
LMArena French1459—
LMArena German1432—
LMArena Japanese1378—
LMArena Korean1380—
LMArena Russian1411—
LMArena Spanish1433—

Instruction Following Not comparable

Mistral Medium: 73.7 (#116), Nova 2.0 Pro Preview: —

Instruction Following benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
LMArena Instruction Following1398—

Long Context Not comparable

Mistral Medium: 42.9 (#114), Nova 2.0 Pro Preview: —

Long Context benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
LMArena Longer Query1406—

Writing & Preference Not comparable

Mistral Medium: 60.0 (#103), Nova 2.0 Pro Preview: —

Writing & Preference benchmarks
BenchmarkMistral MediumNova 2.0 Pro Preview
LMArena Text1424—
LMArena Creative Writing1391—
Short-Story Creative Writing77.3%—
LMArena Multi-Turn1418—

Frequently asked questions

Is Mistral Medium better than Nova 2.0 Pro Preview?

Mistral Medium is the stronger model overall, scoring 36.3 to 33.4 on the Noometry Index.

Is Mistral Medium or Nova 2.0 Pro Preview better for coding?

Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.8 versus 34.2 in the Noometry coding category.

How many benchmarks do Mistral Medium and Nova 2.0 Pro Preview share?

2 benchmarks have published results for both models. Mistral Medium has 36 scored results on Noometry and Nova 2.0 Pro Preview has 3.

Related comparisons

Go deeper