Model comparison

Devstral Small 2505 vs MiniMax-M2.5

MiniMax-M2.5 is the stronger model overall, scoring 38.3 to 34.3 on the Noometry Index. Devstral Small 2505 costs 3.5× less per token, which makes it the better buy when MiniMax-M2.5's lead doesn't matter for your workload.

Last verified . 2 shared benchmarks.

Devstral Small 2505 Mistral AI

34.3

Rank #233 Reported

MiniMax-M2.5 MiniMax

38.3

Rank #188 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Devstral Small 2505 scores higher in 1 category and MiniMax-M2.5 in 1 category; 2 gaps are clear of the uncertainty.
  • The widest gap is in coding, where MiniMax-M2.5 leads 48.1 to 38.9.
  • The biggest single-benchmark swing is SWE-bench Verified (bash only): 56.4% for Devstral Small 2505 and 75.8% for MiniMax-M2.5.
  • Devstral Small 2505 is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.30 / $1.20 for MiniMax-M2.5.
  • MiniMax-M2.5 accepts more context: 205K tokens versus 128K.

Side by side

Devstral Small 2505 and MiniMax-M2.5 specifications
Devstral Small 2505MiniMax-M2.5
ProviderMistral AIMiniMax
Noometry Index34.338.3
Released2025-05-072026-02-12
WeightsOpenOpen
Context window128K205K
Max output128K131K
Input $ / M tokens$0.10$0.30
Output $ / M tokens$0.30$1.20
Results tracked433

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.5 leads

Devstral Small 2505: 38.9 (#166), MiniMax-M2.5: 48.1 (#58)

Coding benchmarks
BenchmarkDevstral Small 2505MiniMax-M2.5
SWE-bench Verified (bash only)56.4%75.8%
LMArena WebDev—1387
SWE-bench Multilingual—68.3%
SciCode28.8%—
LMArena Coding—1381
ALE-Bench—618.17

Agentic & Tool Use Not comparable

Devstral Small 2505: —, MiniMax-M2.5: 30.4 (#77)

Agentic & Tool Use benchmarks
BenchmarkDevstral Small 2505MiniMax-M2.5
Terminal-Bench—42.7%
Vending-Bench 2—-23.16

Reasoning Devstral Small 2505 leads

Devstral Small 2505: 19.7 (#252), MiniMax-M2.5: 17.5 (#292)

Reasoning benchmarks
BenchmarkDevstral Small 2505MiniMax-M2.5
Kagi LLM Benchmark37.7%55.2%
ARC-AGI-2—4.9%
NYT Connections (extended)—16.8%
ARC-AGI-1—63.7%
CritPt0%—
LMArena Hard Prompts—1372
Epoch Capabilities Index—146.68

Math Not comparable

Devstral Small 2505: —, MiniMax-M2.5: 26.9 (#253)

Math benchmarks
BenchmarkDevstral Small 2505MiniMax-M2.5
ProofBench—4%
LMArena Math—1378

Knowledge Not comparable

Devstral Small 2505: —, MiniMax-M2.5: 39.2 (#135)

Knowledge benchmarks
BenchmarkDevstral Small 2505MiniMax-M2.5
Vectara Hallucination Rate—9.1%
LMArena Expert—1379

Multilingual Not comparable

Devstral Small 2505: —, MiniMax-M2.5: 47.1 (#152)

Multilingual benchmarks
BenchmarkDevstral Small 2505MiniMax-M2.5
LMArena Non-English—1338
LMArena Chinese—1393
LMArena French—1362
LMArena German—1362
LMArena Japanese—1171
LMArena Korean—1232
LMArena Russian—1358
LMArena Spanish—1354

Instruction Following Not comparable

Devstral Small 2505: —, MiniMax-M2.5: 71.5 (#148)

Instruction Following benchmarks
BenchmarkDevstral Small 2505MiniMax-M2.5
LMArena Instruction Following—1353

Long Context Not comparable

Devstral Small 2505: —, MiniMax-M2.5: 37.5 (#216)

Long Context benchmarks
BenchmarkDevstral Small 2505MiniMax-M2.5
CL-bench—11.4%
CL-bench Life—6.3%
LMArena Longer Query—1366

Writing & Preference Not comparable

Devstral Small 2505: —, MiniMax-M2.5: 53.9 (#153)

Writing & Preference benchmarks
BenchmarkDevstral Small 2505MiniMax-M2.5
LMArena Text—1359
LMArena Creative Writing—1331
EQ-Bench Creative Writing—1361
LMArena Multi-Turn—1364

Frequently asked questions

Is Devstral Small 2505 better than MiniMax-M2.5?

MiniMax-M2.5 is the stronger model overall, scoring 38.3 to 34.3 on the Noometry Index. Devstral Small 2505 costs 3.5× less per token, which makes it the better buy when MiniMax-M2.5's lead doesn't matter for your workload.

Which is cheaper, Devstral Small 2505 or MiniMax-M2.5?

Devstral Small 2505 is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; MiniMax-M2.5 lists at $0.30 and $1.20.

Is Devstral Small 2505 or MiniMax-M2.5 better for coding?

MiniMax-M2.5 scores higher on coding benchmarks: 48.1 versus 38.9 in the Noometry coding category.

Which has the bigger context window?

MiniMax-M2.5 does, with 205K tokens against 128K.

How many benchmarks do Devstral Small 2505 and MiniMax-M2.5 share?

2 benchmarks have published results for both models. Devstral Small 2505 has 4 scored results on Noometry and MiniMax-M2.5 has 33.

Related comparisons

Go deeper