Model comparison
Devstral Small 2505 vs Nova Premier 1.0
Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 34.3 on the Noometry Index. Devstral Small 2505 costs 33× less per token, which makes it the better buy when Nova Premier 1.0's lead doesn't matter for your workload.
Last verified . 1 shared benchmarks.
Mistral AISummary
- They share 1 benchmark with published results for both. Devstral Small 2505 scores higher in 0 categories and Nova Premier 1.0 in 1 category; one gap is clear of the uncertainty.
- The widest gap is in reasoning, where Nova Premier 1.0 leads 23.0 to 19.7.
- The biggest single-benchmark swing is Kagi LLM Benchmark: 37.7% for Devstral Small 2505 and 44.8% for Nova Premier 1.0.
- Devstral Small 2505 is cheaper at $0.10 / $0.30 per million input/output tokens, against $2.50 / $12.50 for Nova Premier 1.0.
- Nova Premier 1.0 accepts more context: 1M tokens versus 128K.
- Devstral Small 2505 has downloadable open weights; the other is API-only.
Side by side
| Devstral Small 2505 | Nova Premier 1.0 | |
|---|---|---|
| Provider | Mistral AI | Amazon |
| Noometry Index | 34.3 | 38.3 |
| Released | 2025-05-07 | 2025-04-30 |
| Weights | Open | Proprietary |
| Context window | 128K | 1M |
| Max output | 128K | 10K |
| Input $ / M tokens | $0.10 | $2.50 |
| Output $ / M tokens | $0.30 | $12.50 |
| Results tracked | 4 | 6 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Devstral Small 2505: 38.9 (#166), Nova Premier 1.0: —
| Benchmark | Devstral Small 2505 | Nova Premier 1.0 |
|---|---|---|
| SWE-bench Verified (bash only) | 56.4% | — |
| SciCode | 28.8% | — |
Reasoning Nova Premier 1.0 leads
Devstral Small 2505: 19.7 (#252), Nova Premier 1.0: 23.0 (#185)
| Benchmark | Devstral Small 2505 | Nova Premier 1.0 |
|---|---|---|
| Kagi LLM Benchmark | 37.7% | 44.8% |
| CritPt | 0% | — |
Math Not comparable
Devstral Small 2505: —, Nova Premier 1.0: 33.8 (#199)
| Benchmark | Devstral Small 2505 | Nova Premier 1.0 |
|---|---|---|
| Omni-MATH | — | 35% |
Knowledge Not comparable
Devstral Small 2505: —, Nova Premier 1.0: 35.8 (#180)
| Benchmark | Devstral Small 2505 | Nova Premier 1.0 |
|---|---|---|
| MMLU-Pro | — | 72.6% |
| GPQA (HELM) | — | 51.8% |
Instruction Following Not comparable
Devstral Small 2505: —, Nova Premier 1.0: 66.8 (#204)
| Benchmark | Devstral Small 2505 | Nova Premier 1.0 |
|---|---|---|
| IFEval | — | 80.3% |
Writing & Preference Not comparable
Devstral Small 2505: —, Nova Premier 1.0: 51.0 (#178)
| Benchmark | Devstral Small 2505 | Nova Premier 1.0 |
|---|---|---|
| WildBench | — | 78.8% |
Frequently asked questions
Is Devstral Small 2505 better than Nova Premier 1.0?
Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 34.3 on the Noometry Index. Devstral Small 2505 costs 33× less per token, which makes it the better buy when Nova Premier 1.0's lead doesn't matter for your workload.
Which is cheaper, Devstral Small 2505 or Nova Premier 1.0?
Devstral Small 2505 is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Nova Premier 1.0 lists at $2.50 and $12.50.
Which has the bigger context window?
Nova Premier 1.0 does, with 1M tokens against 128K.
How many benchmarks do Devstral Small 2505 and Nova Premier 1.0 share?
1 benchmark has published results for both models. Devstral Small 2505 has 4 scored results on Noometry and Nova Premier 1.0 has 6.