Model comparison
Devstral Small 2505 vs Qwen3.7 Flash
Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 34.3 on the Noometry Index.
Last verified . 0 shared benchmarks.
Mistral AI
Alibaba (Qwen)Summary
- The widest gap is in reasoning, where Qwen3.7 Flash leads 28.2 to 19.7.
- Qwen3.7 Flash is cheaper at $0.03 / $0.13 per million input/output tokens, against $0.10 / $0.30 for Devstral Small 2505.
- Qwen3.7 Flash accepts more context: 1M tokens versus 128K.
- Devstral Small 2505 has downloadable open weights; the other is API-only.
Side by side
| Devstral Small 2505 | Qwen3.7 Flash | |
|---|---|---|
| Provider | Mistral AI | Alibaba (Qwen) |
| Noometry Index | 34.3 | 39.9 |
| Released | 2025-05-07 | 2026-07-15 |
| Weights | Open | Proprietary |
| Context window | 128K | 1M |
| Max output | 128K | 131K |
| Input $ / M tokens | $0.10 | $0.03 |
| Output $ / M tokens | $0.30 | $0.13 |
| Results tracked | 4 | 7 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Devstral Small 2505: 38.9 (#166), Qwen3.7 Flash: —
| Benchmark | Devstral Small 2505 | Qwen3.7 Flash |
|---|---|---|
| SWE-bench Verified (bash only) | 56.4% | — |
| SciCode | 28.8% | — |
Reasoning Qwen3.7 Flash leads
Devstral Small 2505: 19.7 (#252), Qwen3.7 Flash: 28.2 (#108)
| Benchmark | Devstral Small 2505 | Qwen3.7 Flash |
|---|---|---|
| Kagi LLM Benchmark | 37.7% | — |
| NYT Connections (extended) | — | 43.8% |
| CritPt | 0% | — |
| Chess Puzzles | — | 23% |
| Mystery Game Puzzles | — | 15% |
| Epoch Capabilities Index | — | 144.64 |
Math Not comparable
Devstral Small 2505: —, Qwen3.7 Flash: 38.3 (#140)
| Benchmark | Devstral Small 2505 | Qwen3.7 Flash |
|---|---|---|
| FrontierMath (Tiers 1-3) | — | 19.3% |
| OTIS Mock AIME 2024-2025 | — | 86.7% |
Knowledge Not comparable
Devstral Small 2505: —, Qwen3.7 Flash: 48.9 (#75)
| Benchmark | Devstral Small 2505 | Qwen3.7 Flash |
|---|---|---|
| GPQA Diamond | — | 82.3% |
Frequently asked questions
Is Devstral Small 2505 better than Qwen3.7 Flash?
Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 34.3 on the Noometry Index.
Which is cheaper, Devstral Small 2505 or Qwen3.7 Flash?
Qwen3.7 Flash is cheaper. It lists at $0.03 per million input tokens and $0.13 per million output tokens; Devstral Small 2505 lists at $0.10 and $0.30.
Which has the bigger context window?
Qwen3.7 Flash does, with 1M tokens against 128K.
How many benchmarks do Devstral Small 2505 and Qwen3.7 Flash share?
0 benchmarks have published results for both models. Devstral Small 2505 has 4 scored results on Noometry and Qwen3.7 Flash has 7.