Model comparison

Devstral Small 2505 vs MiMo-V2-Flash

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 34.3 on the Noometry Index.

Last verified . 2 shared benchmarks.

Devstral Small 2505 Mistral AI

34.3

Rank #233 Reported

MiMo-V2-Flash Xiaomi

41.3

Rank #138 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Devstral Small 2505 scores higher in 1 category and MiMo-V2-Flash in 1 category; 2 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where MiMo-V2-Flash leads 24.9 to 19.7.
  • Devstral Small 2505 is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.14 / $0.28 for MiMo-V2-Flash.
  • MiMo-V2-Flash accepts more context: 262K tokens versus 128K.

Side by side

Devstral Small 2505 and MiMo-V2-Flash specifications
Devstral Small 2505MiMo-V2-Flash
ProviderMistral AIXiaomi
Noometry Index34.341.3
Released2025-05-072025-12-16
WeightsOpenOpen
Context window128K262K
Max output128K66K
Input $ / M tokens$0.10$0.14
Output $ / M tokens$0.30$0.28
Results tracked421

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Devstral Small 2505 leads

Devstral Small 2505: 38.9 (#166), MiMo-V2-Flash: 36.1 (#211)

Coding benchmarks
BenchmarkDevstral Small 2505MiMo-V2-Flash
SciCode28.8%25.9%
SWE-bench Verified (bash only)56.4%—
LMArena WebDev—1330
LMArena Coding—1443
ALE-Bench—737.95

Reasoning MiMo-V2-Flash leads

Devstral Small 2505: 19.7 (#252), MiMo-V2-Flash: 24.9 (#157)

Reasoning benchmarks
BenchmarkDevstral Small 2505MiMo-V2-Flash
CritPt0%0%
Kagi LLM Benchmark37.7%—
LMArena Hard Prompts—1420

Math Not comparable

Devstral Small 2505: —, MiMo-V2-Flash: 38.3 (#139)

Math benchmarks
BenchmarkDevstral Small 2505MiMo-V2-Flash
LMArena Math—1396

Knowledge Not comparable

Devstral Small 2505: —, MiMo-V2-Flash: 39.7 (#131)

Knowledge benchmarks
BenchmarkDevstral Small 2505MiMo-V2-Flash
LMArena Expert—1425

Multilingual Not comparable

Devstral Small 2505: —, MiMo-V2-Flash: 51.0 (#113)

Multilingual benchmarks
BenchmarkDevstral Small 2505MiMo-V2-Flash
LMArena Non-English—1392
LMArena Chinese—1462
LMArena French—1429
LMArena German—1395
LMArena Japanese—1325
LMArena Korean—1358
LMArena Russian—1387
LMArena Spanish—1420

Instruction Following Not comparable

Devstral Small 2505: —, MiMo-V2-Flash: 73.5 (#120)

Instruction Following benchmarks
BenchmarkDevstral Small 2505MiMo-V2-Flash
LMArena Instruction Following—1392

Long Context Not comparable

Devstral Small 2505: —, MiMo-V2-Flash: 43.0 (#110)

Long Context benchmarks
BenchmarkDevstral Small 2505MiMo-V2-Flash
LMArena Longer Query—1409

Writing & Preference Not comparable

Devstral Small 2505: —, MiMo-V2-Flash: 59.7 (#106)

Writing & Preference benchmarks
BenchmarkDevstral Small 2505MiMo-V2-Flash
LMArena Text—1411
LMArena Creative Writing—1375
LMArena Multi-Turn—1404

Frequently asked questions

Is Devstral Small 2505 better than MiMo-V2-Flash?

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 34.3 on the Noometry Index.

Which is cheaper, Devstral Small 2505 or MiMo-V2-Flash?

Devstral Small 2505 is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; MiMo-V2-Flash lists at $0.14 and $0.28.

Is Devstral Small 2505 or MiMo-V2-Flash better for coding?

Devstral Small 2505 scores higher on coding benchmarks: 38.9 versus 36.1 in the Noometry coding category.

Which has the bigger context window?

MiMo-V2-Flash does, with 262K tokens against 128K.

How many benchmarks do Devstral Small 2505 and MiMo-V2-Flash share?

2 benchmarks have published results for both models. Devstral Small 2505 has 4 scored results on Noometry and MiMo-V2-Flash has 21.

Related comparisons

Go deeper