Model comparison
Mistral Medium vs Nova Premier 1.0
Nova Premier 1.0 is the stronger model overall, scoring 37.7 to 36.0 on the Noometry Index. Mistral Medium costs 1.7× less per token, which makes it the better buy when Nova Premier 1.0's lead doesn't matter for your workload.
Last verified . 1 shared benchmarks.
Mistral AISummary
- They share 1 benchmark with published results for both. Mistral Medium scores higher in 3 categories and Nova Premier 1.0 in 2 categories; 5 gaps are clear of the uncertainty.
- The widest gap is in knowledge, where Nova Premier 1.0 leads 35.4 to 24.9.
- The biggest single-benchmark swing is Kagi LLM Benchmark: 50% for Mistral Medium and 44.8% for Nova Premier 1.0.
- Mistral Medium is cheaper at $1.50 / $7.50 per million input/output tokens, against $2.50 / $12.50 for Nova Premier 1.0.
- Nova Premier 1.0 accepts more context: 1M tokens versus 262K.
- Mistral Medium has downloadable open weights; the other is API-only.
Side by side
| Mistral Medium | Nova Premier 1.0 | |
|---|---|---|
| Provider | Mistral AI | Amazon |
| Noometry Index | 36.0 | 37.7 |
| Released | 2023-12-11 | 2025-04-30 |
| Weights | Open | Proprietary |
| Context window | 262K | 1M |
| Max output | 262K | 10K |
| Input $ / M tokens | $1.50 | $2.50 |
| Output $ / M tokens | $7.50 | $12.50 |
| Results tracked | 36 | 6 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Mistral Medium: 33.8 (#241), Nova Premier 1.0: —
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| FrontierCode | 8% | — |
| SciCode | 40.2% | — |
| WeirdML | 43.7% | — |
| LMArena Coding | 1434 | — |
| ALE-Bench | 763.98 | — |
Agentic & Tool Use Not comparable
Mistral Medium: 28.1 (#84), Nova Premier 1.0: —
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| Berkeley Function Calling Leaderboard | 37.7% | — |
Reasoning Mistral Medium leads
Mistral Medium: 23.3 (#165), Nova Premier 1.0: 22.3 (#182)
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| Kagi LLM Benchmark | 50% | 44.8% |
| CritPt | 0% | — |
| LMArena Hard Prompts | 1426 | — |
| DTBench | 75.5% | — |
| LMCA | 26.1% | — |
| Surface Evolver Bench | 26.9% | — |
Math Nova Premier 1.0 leads
Mistral Medium: 27.2 (#238), Nova Premier 1.0: 31.5 (#194)
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| OTIS Mock AIME 2024-2025 | 32.2% | — |
| ProofBench | 9% | — |
| Omni-MATH | — | 35% |
| LMArena Math | 1409 | — |
| MATH Level 5 | 81.6% | — |
| FrontierMath (Feb 2025 set) | 0.3% | — |
Knowledge Nova Premier 1.0 leads
Mistral Medium: 24.9 (#260), Nova Premier 1.0: 35.4 (#176)
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| GPQA Diamond | 59.5% | — |
| Humanity's Last Exam | 4.5% | — |
| MMLU-Pro | — | 72.6% |
| Vectara Hallucination Rate | 22.7% | — |
| GPQA (HELM) | — | 51.8% |
| LMArena Expert | 1408 | — |
Multimodal Not comparable
Mistral Medium: 34.6 (#82), Nova Premier 1.0: —
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| LMArena Vision | 1172 | — |
Multilingual Not comparable
Mistral Medium: 52.3 (#86), Nova Premier 1.0: —
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| LMArena Non-English | 1408 | — |
| LMArena Chinese | 1448 | — |
| LMArena French | 1460 | — |
| LMArena German | 1433 | — |
| LMArena Japanese | 1378 | — |
| LMArena Korean | 1382 | — |
| LMArena Russian | 1411 | — |
| LMArena Spanish | 1433 | — |
Instruction Following Mistral Medium leads
Mistral Medium: 73.9 (#111), Nova Premier 1.0: 66.9 (#201)
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| IFEval | — | 80.3% |
| LMArena Instruction Following | 1398 | — |
Long Context Not comparable
Mistral Medium: 42.9 (#108), Nova Premier 1.0: —
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| LMArena Longer Query | 1406 | — |
Writing & Preference Mistral Medium leads
Mistral Medium: 60.2 (#97), Nova Premier 1.0: 51.0 (#174)
| Benchmark | Mistral Medium | Nova Premier 1.0 |
|---|---|---|
| LMArena Text | 1424 | — |
| LMArena Creative Writing | 1391 | — |
| Short-Story Creative Writing | 77.3% | — |
| WildBench | — | 78.8% |
| LMArena Multi-Turn | 1418 | — |
Frequently asked questions
Is Mistral Medium better than Nova Premier 1.0?
Nova Premier 1.0 is the stronger model overall, scoring 37.7 to 36.0 on the Noometry Index. Mistral Medium costs 1.7× less per token, which makes it the better buy when Nova Premier 1.0's lead doesn't matter for your workload.
Which is cheaper, Mistral Medium or Nova Premier 1.0?
Mistral Medium is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; Nova Premier 1.0 lists at $2.50 and $12.50.
Which has the bigger context window?
Nova Premier 1.0 does, with 1M tokens against 262K.
How many benchmarks do Mistral Medium and Nova Premier 1.0 share?
1 benchmark has published results for both models. Mistral Medium has 36 scored results on Noometry and Nova Premier 1.0 has 6.