Model comparison
Devstral Small 2505 vs Qwen2.5-Coder-32B
Devstral Small 2505 and Qwen2.5-Coder-32B score almost the same on the Noometry Index (34.3 vs 33.4), so choose on price, context window or the category you care about most.
Last verified . 1 shared benchmarks.
Mistral AI
Alibaba (Qwen)Summary
- They share 1 benchmark with published results for both. Devstral Small 2505 scores higher in 1 category and Qwen2.5-Coder-32B in 1 category; 2 gaps are clear of the uncertainty.
- The widest gap is in coding, where Devstral Small 2505 leads 38.9 to 22.6.
- The biggest single-benchmark swing is SWE-bench Verified (bash only): 56.4% for Devstral Small 2505 and 9% for Qwen2.5-Coder-32B.
- Devstral Small 2505 is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.66 / $1 for Qwen2.5-Coder-32B.
- Devstral Small 2505 accepts more context: 128K tokens versus 33K.
Side by side
| Devstral Small 2505 | Qwen2.5-Coder-32B | |
|---|---|---|
| Provider | Mistral AI | Alibaba (Qwen) |
| Noometry Index | 34.3 | 33.4 |
| Released | 2025-05-07 | 2024-09-18 |
| Weights | Open | Open |
| Context window | 128K | 33K |
| Max output | 128K | 29K |
| Input $ / M tokens | $0.10 | $0.66 |
| Output $ / M tokens | $0.30 | $1 |
| Results tracked | 4 | 31 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Devstral Small 2505 leads
Devstral Small 2505: 38.9 (#166), Qwen2.5-Coder-32B: 22.6 (#333)
| Benchmark | Devstral Small 2505 | Qwen2.5-Coder-32B |
|---|---|---|
| SWE-bench Verified (bash only) | 56.4% | 9% |
| Aider Polyglot | — | 16.4% |
| SciCode | 28.8% | — |
| BigCodeBench Instruct | — | 49% |
| LiveBench Coding | — | 56.9% |
| LMArena Coding | — | 1276 |
| BigCodeBench Complete | — | 58% |
| HumanEval+ | — | 87.2% |
| MBPP+ | — | 77% |
Reasoning Qwen2.5-Coder-32B leads
Devstral Small 2505: 19.7 (#252), Qwen2.5-Coder-32B: 21.2 (#225)
| Benchmark | Devstral Small 2505 | Qwen2.5-Coder-32B |
|---|---|---|
| Kagi LLM Benchmark | 37.7% | — |
| CritPt | 0% | — |
| LiveBench Reasoning | — | 42.1% |
| LMArena Hard Prompts | — | 1251 |
| LiveBench Data Analysis | — | 49.9% |
| Epoch Capabilities Index | — | 119.49 |
| HellaSwag | — | 83% |
| LiveBench | — | 46.2% |
| WinoGrande | — | 80.8% |
Math Not comparable
Devstral Small 2505: —, Qwen2.5-Coder-32B: 33.3 (#204)
| Benchmark | Devstral Small 2505 | Qwen2.5-Coder-32B |
|---|---|---|
| LiveBench Math | — | 46.6% |
| LMArena Math | — | 1251 |
| GSM8K | — | 93% |
Knowledge Not comparable
Devstral Small 2505: —, Qwen2.5-Coder-32B: 33.4 (#203)
| Benchmark | Devstral Small 2505 | Qwen2.5-Coder-32B |
|---|---|---|
| LMArena Expert | — | 1221 |
| ARC (AI2) Challenge | — | 70.5% |
| MMLU | — | 79.1% |
Multilingual Not comparable
Devstral Small 2505: —, Qwen2.5-Coder-32B: 37.8 (#235)
| Benchmark | Devstral Small 2505 | Qwen2.5-Coder-32B |
|---|---|---|
| LMArena Non-English | — | 1205 |
| LMArena Chinese | — | 1222 |
| LMArena Russian | — | 1228 |
Instruction Following Not comparable
Devstral Small 2505: —, Qwen2.5-Coder-32B: 61.4 (#245)
| Benchmark | Devstral Small 2505 | Qwen2.5-Coder-32B |
|---|---|---|
| LiveBench Instruction Following | — | 58.7% |
| LMArena Instruction Following | — | 1223 |
Long Context Not comparable
Devstral Small 2505: —, Qwen2.5-Coder-32B: 38.0 (#208)
| Benchmark | Devstral Small 2505 | Qwen2.5-Coder-32B |
|---|---|---|
| LMArena Longer Query | — | 1251 |
Writing & Preference Not comparable
Devstral Small 2505: —, Qwen2.5-Coder-32B: 41.6 (#240)
| Benchmark | Devstral Small 2505 | Qwen2.5-Coder-32B |
|---|---|---|
| LMArena Text | — | 1230 |
| LMArena Creative Writing | — | 1174 |
| LMArena Multi-Turn | — | 1222 |
| LiveBench Language | — | 23.3% |
Frequently asked questions
Is Devstral Small 2505 better than Qwen2.5-Coder-32B?
Devstral Small 2505 and Qwen2.5-Coder-32B score almost the same on the Noometry Index (34.3 vs 33.4), so choose on price, context window or the category you care about most.
Which is cheaper, Devstral Small 2505 or Qwen2.5-Coder-32B?
Devstral Small 2505 is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Qwen2.5-Coder-32B lists at $0.66 and $1.
Is Devstral Small 2505 or Qwen2.5-Coder-32B better for coding?
Devstral Small 2505 scores higher on coding benchmarks: 38.9 versus 22.6 in the Noometry coding category.
Which has the bigger context window?
Devstral Small 2505 does, with 128K tokens against 33K.
How many benchmarks do Devstral Small 2505 and Qwen2.5-Coder-32B share?
1 benchmark has published results for both models. Devstral Small 2505 has 4 scored results on Noometry and Qwen2.5-Coder-32B has 31.