Model comparison

Codestral vs Devstral Small 2505

Devstral Small 2505 is the stronger model overall, scoring 34.3 to 30.6 on the Noometry Index.

Last verified . 1 shared benchmarks.

Codestral Mistral AI

30.6

Rank #290 Reported

Devstral Small 2505 Mistral AI

34.3

Rank #233 Reported

Summary

  • They share 1 benchmark with published results for both. Codestral scores higher in 1 category and Devstral Small 2505 in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Devstral Small 2505 leads 38.9 to 27.3.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 32.5% for Codestral and 37.7% for Devstral Small 2505.
  • Devstral Small 2505 is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.30 / $0.90 for Codestral.
  • Codestral accepts more context: 256K tokens versus 128K.
  • Devstral Small 2505 has downloadable open weights; the other is API-only.

Side by side

Codestral and Devstral Small 2505 specifications
CodestralDevstral Small 2505
ProviderMistral AIMistral AI
Noometry Index30.634.3
Released2024-05-292025-05-07
WeightsProprietaryOpen
Context window256K128K
Max output8K128K
Input $ / M tokens$0.30$0.10
Output $ / M tokens$0.90$0.30
Results tracked74

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Devstral Small 2505 leads

Codestral: 27.3 (#321), Devstral Small 2505: 38.9 (#166)

Coding benchmarks
BenchmarkCodestralDevstral Small 2505
SWE-bench Verified (bash only)—56.4%
Aider Polyglot11.1%—
SciCode—28.8%
BigCodeBench Instruct41.8%—
BigCodeBench Complete52.5%—
ALE-Bench137.78—
HumanEval+73.8%—
MBPP+61.9%—

Reasoning Too close to call

Codestral: 19.8 (#251), Devstral Small 2505: 19.7 (#252)

Reasoning benchmarks
BenchmarkCodestralDevstral Small 2505
Kagi LLM Benchmark32.5%37.7%
CritPt—0%

Frequently asked questions

Is Codestral better than Devstral Small 2505?

Devstral Small 2505 is the stronger model overall, scoring 34.3 to 30.6 on the Noometry Index.

Which is cheaper, Codestral or Devstral Small 2505?

Devstral Small 2505 is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Codestral lists at $0.30 and $0.90.

Is Codestral or Devstral Small 2505 better for coding?

Devstral Small 2505 scores higher on coding benchmarks: 38.9 versus 27.3 in the Noometry coding category.

Which has the bigger context window?

Codestral does, with 256K tokens against 128K.

How many benchmarks do Codestral and Devstral Small 2505 share?

1 benchmark has published results for both models. Codestral has 7 scored results on Noometry and Devstral Small 2505 has 4.

Related comparisons

Go deeper