Model comparison
DeepSeek Coder 6.7B vs Devstral Small 2505
Devstral Small 2505 has enough public results to be ranked (#233); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.
Last verified . 0 shared benchmarks.
DeepSeek
Mistral AISummary
- The widest gap is in coding, where Devstral Small 2505 leads 38.9 to 35.8.
Side by side
| DeepSeek Coder 6.7B | Devstral Small 2505 | |
|---|---|---|
| Provider | DeepSeek | Mistral AI |
| Noometry Index | 37.6 | 34.3 |
| Released | 2023-11-02 | 2025-05-07 |
| Weights | Open | Open |
| Context window | — | 128K |
| Max output | — | 128K |
| Input $ / M tokens | — | $0.10 |
| Output $ / M tokens | — | $0.30 |
| Results tracked | 9 | 4 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Devstral Small 2505 leads
DeepSeek Coder 6.7B: 35.8 (#219), Devstral Small 2505: 38.9 (#166)
| Benchmark | DeepSeek Coder 6.7B | Devstral Small 2505 |
|---|---|---|
| SWE-bench Verified (bash only) | — | 56.4% |
| SciCode | — | 28.8% |
| BigCodeBench Instruct | 35.5% | — |
| BigCodeBench Complete | 43.8% | — |
| HumanEval+ | 71.3% | — |
| MBPP+ | 65.6% | — |
Reasoning Not comparable
DeepSeek Coder 6.7B: —, Devstral Small 2505: 19.7 (#252)
| Benchmark | DeepSeek Coder 6.7B | Devstral Small 2505 |
|---|---|---|
| Kagi LLM Benchmark | — | 37.7% |
| CritPt | — | 0% |
| Epoch Capabilities Index | 89.62 | — |
| WinoGrande | 57.6% | — |
Math Not comparable
DeepSeek Coder 6.7B: —, Devstral Small 2505: —
| Benchmark | DeepSeek Coder 6.7B | Devstral Small 2505 |
|---|---|---|
| GSM8K | 21.3% | — |
Knowledge Not comparable
DeepSeek Coder 6.7B: —, Devstral Small 2505: —
| Benchmark | DeepSeek Coder 6.7B | Devstral Small 2505 |
|---|---|---|
| ARC (AI2) Challenge | 36.4% | — |
| MMLU | 36.4% | — |
Frequently asked questions
Is DeepSeek Coder 6.7B better than Devstral Small 2505?
Devstral Small 2505 has enough public results to be ranked (#233); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.
Is DeepSeek Coder 6.7B or Devstral Small 2505 better for coding?
Devstral Small 2505 scores higher on coding benchmarks: 38.9 versus 35.8 in the Noometry coding category.
How many benchmarks do DeepSeek Coder 6.7B and Devstral Small 2505 share?
0 benchmarks have published results for both models. DeepSeek Coder 6.7B has 9 scored results on Noometry and Devstral Small 2505 has 4.