Model comparison
Devstral Small 2505 vs Qwen2.5-VL 72B Instruct
Devstral Small 2505 is the stronger model overall, scoring 34.3 to 29.9 on the Noometry Index.
Last verified . 1 shared benchmarks.
Mistral AI
Alibaba (Qwen)Summary
- They share 1 benchmark with published results for both. Devstral Small 2505 scores higher in 0 categories and Qwen2.5-VL 72B Instruct in 1 category, but none of those gaps is larger than the uncertainty.
- Devstral Small 2505 is cheaper at $0.10 / $0.30 per million input/output tokens, against $2.80 / $8.40 for Qwen2.5-VL 72B Instruct.
- Qwen2.5-VL 72B Instruct accepts more context: 131K tokens versus 128K.
Side by side
| Devstral Small 2505 | Qwen2.5-VL 72B Instruct | |
|---|---|---|
| Provider | Mistral AI | Alibaba (Qwen) |
| Noometry Index | 34.3 | 29.9 |
| Released | 2025-05-07 | 2024-09 |
| Weights | Open | Open |
| Context window | 128K | 131K |
| Max output | 128K | 8K |
| Input $ / M tokens | $0.10 | $2.80 |
| Output $ / M tokens | $0.30 | $8.40 |
| Results tracked | 4 | 6 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Devstral Small 2505: 38.9 (#166), Qwen2.5-VL 72B Instruct: —
| Benchmark | Devstral Small 2505 | Qwen2.5-VL 72B Instruct |
|---|---|---|
| SWE-bench Verified (bash only) | 56.4% | — |
| SciCode | 28.8% | — |
Agentic & Tool Use Not comparable
Devstral Small 2505: —, Qwen2.5-VL 72B Instruct: 18.6 (#144)
| Benchmark | Devstral Small 2505 | Qwen2.5-VL 72B Instruct |
|---|---|---|
| OSWorld | — | 5% |
Reasoning Too close to call
Devstral Small 2505: 19.7 (#252), Qwen2.5-VL 72B Instruct: 20.7 (#233)
| Benchmark | Devstral Small 2505 | Qwen2.5-VL 72B Instruct |
|---|---|---|
| Kagi LLM Benchmark | 37.7% | 36% |
| CritPt | 0% | — |
Multimodal Not comparable
Devstral Small 2505: —, Qwen2.5-VL 72B Instruct: 33.5 (#97)
| Benchmark | Devstral Small 2505 | Qwen2.5-VL 72B Instruct |
|---|---|---|
| LMArena Vision | — | 1107 |
| Video-MME | — | 73.5% |
| GeoBench | — | 62% |
| SpatialViz-Bench | — | 33.3% |
Frequently asked questions
Is Devstral Small 2505 better than Qwen2.5-VL 72B Instruct?
Devstral Small 2505 is the stronger model overall, scoring 34.3 to 29.9 on the Noometry Index.
Which is cheaper, Devstral Small 2505 or Qwen2.5-VL 72B Instruct?
Devstral Small 2505 is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Qwen2.5-VL 72B Instruct lists at $2.80 and $8.40.
Which has the bigger context window?
Qwen2.5-VL 72B Instruct does, with 131K tokens against 128K.
How many benchmarks do Devstral Small 2505 and Qwen2.5-VL 72B Instruct share?
1 benchmark has published results for both models. Devstral Small 2505 has 4 scored results on Noometry and Qwen2.5-VL 72B Instruct has 6.