Model comparison
Mistral Medium vs Nova 2.0 Pro Preview
Mistral Medium is the stronger model overall, scoring 36.3 to 33.4 on the Noometry Index.
Last verified . 2 shared benchmarks.
Summary
- They share 2 benchmarks with published results for both. Mistral Medium scores higher in 2 categories and Nova 2.0 Pro Preview in 1 category; 3 gaps are clear of the uncertainty.
- The widest gap is in coding, where Nova 2.0 Pro Preview leads 40.8 to 34.2.
- Mistral Medium has downloadable open weights; the other is API-only.
Side by side
| Mistral Medium | Nova 2.0 Pro Preview | |
|---|---|---|
| Provider | Mistral AI | Amazon |
| Noometry Index | 36.3 | 33.4 |
| Released | 2023-12-11 | 2025-12-02 |
| Weights | Open | Proprietary |
| Context window | 262K | — |
| Max output | 262K | — |
| Input $ / M tokens | $1.50 | — |
| Output $ / M tokens | $7.50 | — |
| Results tracked | 36 | 3 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Nova 2.0 Pro Preview leads
Mistral Medium: 34.2 (#243), Nova 2.0 Pro Preview: 40.8 (#133)
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| SciCode | 40.2% | 42.7% |
| FrontierCode | 8% | — |
| WeirdML | 43.7% | — |
| LMArena Coding | 1434 | — |
| ALE-Bench | 763.98 | — |
Agentic & Tool Use Mistral Medium leads
Mistral Medium: 28.3 (#90), Nova 2.0 Pro Preview: 21.9 (#136)
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| Berkeley Function Calling Leaderboard | 37.7% | — |
| GDP.pdf | — | 2% |
Reasoning Mistral Medium leads
Mistral Medium: 24.0 (#167), Nova 2.0 Pro Preview: 22.4 (#194)
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| CritPt | 0% | 0% |
| Kagi LLM Benchmark | 50% | — |
| LMArena Hard Prompts | 1426 | — |
| DTBench | 75.5% | — |
| LMCA | 26.1% | — |
| Surface Evolver Bench | 26.9% | — |
Math Not comparable
Mistral Medium: 28.1 (#245), Nova 2.0 Pro Preview: —
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| OTIS Mock AIME 2024-2025 | 32.2% | — |
| ProofBench | 9% | — |
| LMArena Math | 1408 | — |
| MATH Level 5 | 81.6% | — |
| FrontierMath (Feb 2025 set) | 0.3% | — |
Knowledge Not comparable
Mistral Medium: 25.0 (#265), Nova 2.0 Pro Preview: —
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| GPQA Diamond | 59.5% | — |
| Humanity's Last Exam | 4.5% | — |
| Vectara Hallucination Rate | 22.7% | — |
| LMArena Expert | 1408 | — |
Multimodal Not comparable
Mistral Medium: 35.3 (#88), Nova 2.0 Pro Preview: —
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| LMArena Vision | 1172 | — |
Multilingual Not comparable
Mistral Medium: 52.1 (#91), Nova 2.0 Pro Preview: —
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| LMArena Non-English | 1408 | — |
| LMArena Chinese | 1447 | — |
| LMArena French | 1459 | — |
| LMArena German | 1432 | — |
| LMArena Japanese | 1378 | — |
| LMArena Korean | 1380 | — |
| LMArena Russian | 1411 | — |
| LMArena Spanish | 1433 | — |
Instruction Following Not comparable
Mistral Medium: 73.7 (#116), Nova 2.0 Pro Preview: —
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| LMArena Instruction Following | 1398 | — |
Long Context Not comparable
Mistral Medium: 42.9 (#114), Nova 2.0 Pro Preview: —
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| LMArena Longer Query | 1406 | — |
Writing & Preference Not comparable
Mistral Medium: 60.0 (#103), Nova 2.0 Pro Preview: —
| Benchmark | Mistral Medium | Nova 2.0 Pro Preview |
|---|---|---|
| LMArena Text | 1424 | — |
| LMArena Creative Writing | 1391 | — |
| Short-Story Creative Writing | 77.3% | — |
| LMArena Multi-Turn | 1418 | — |
Frequently asked questions
Is Mistral Medium better than Nova 2.0 Pro Preview?
Mistral Medium is the stronger model overall, scoring 36.3 to 33.4 on the Noometry Index.
Is Mistral Medium or Nova 2.0 Pro Preview better for coding?
Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.8 versus 34.2 in the Noometry coding category.
How many benchmarks do Mistral Medium and Nova 2.0 Pro Preview share?
2 benchmarks have published results for both models. Mistral Medium has 36 scored results on Noometry and Nova 2.0 Pro Preview has 3.