Model comparison

Deepseek Coder v2 vs MiMo-V2.5

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 35.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Deepseek Coder v2 DeepSeek

35.9

Rank #220 Confirmed

MiMo-V2.5 Xiaomi

43.4

Rank #93 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Deepseek Coder v2 scores higher in 0 categories and MiMo-V2.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiMo-V2.5 leads 61.6 to 38.2.

Side by side

Deepseek Coder v2 and MiMo-V2.5 specifications
Deepseek Coder v2MiMo-V2.5
ProviderDeepSeekXiaomi
Noometry Index35.943.4
Released2024-06-172026-04-22
WeightsOpenOpen
Context window—1.05M
Max output—131K
Input $ / M tokens—$0.14
Output $ / M tokens—$0.28
Results tracked2423

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2.5 leads

Deepseek Coder v2: 38.1 (#183), MiMo-V2.5: 43.9 (#81)

Coding benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5
LMArena Coding12511469
LMArena WebDev—1438
SciCode—43.1%
BigCodeBench Instruct48.2%—
BigCodeBench Complete59.7%—
ALE-Bench—513.95
HumanEval+82.3%—
MBPP+75.1%—

Reasoning MiMo-V2.5 leads

Deepseek Coder v2: 23.6 (#176), MiMo-V2.5: 28.6 (#101)

Reasoning benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5
LMArena Hard Prompts12071450
CritPt—3.7%
WinoGrande83.7%—

Math MiMo-V2.5 leads

Deepseek Coder v2: 34.9 (#190), MiMo-V2.5: 36.8 (#163)

Math benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5
LMArena Math12411436
ProofBench—16%
GSM8K94.5%—

Knowledge MiMo-V2.5 leads

Deepseek Coder v2: 32.3 (#212), MiMo-V2.5: 40.8 (#115)

Knowledge benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5
LMArena Expert11811460
ARC (AI2) Challenge64.3%—

Multimodal Not comparable

Deepseek Coder v2: —, MiMo-V2.5: 39.8 (#54)

Multimodal benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5
LMArena Vision—1247

Multilingual MiMo-V2.5 leads

Deepseek Coder v2: 36.3 (#240), MiMo-V2.5: 51.9 (#99)

Multilingual benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5
LMArena Non-English11821404
LMArena Chinese12011468
LMArena French11851447
LMArena German11641421
LMArena Japanese11261306
LMArena Korean11041363
LMArena Russian11881395
LMArena Spanish11531416

Instruction Following MiMo-V2.5 leads

Deepseek Coder v2: 61.7 (#242), MiMo-V2.5: 75.5 (#60)

Instruction Following benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5
LMArena Instruction Following11801434

Long Context MiMo-V2.5 leads

Deepseek Coder v2: 37.0 (#224), MiMo-V2.5: 44.2 (#73)

Long Context benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5
LMArena Longer Query12191445

Writing & Preference MiMo-V2.5 leads

Deepseek Coder v2: 38.2 (#253), MiMo-V2.5: 61.6 (#86)

Writing & Preference benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5
LMArena Text11911428
LMArena Creative Writing11201393
LMArena Multi-Turn11771445

Frequently asked questions

Is Deepseek Coder v2 better than MiMo-V2.5?

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 35.9 on the Noometry Index.

Is Deepseek Coder v2 or MiMo-V2.5 better for coding?

MiMo-V2.5 scores higher on coding benchmarks: 43.9 versus 38.1 in the Noometry coding category.

How many benchmarks do Deepseek Coder v2 and MiMo-V2.5 share?

17 benchmarks have published results for both models. Deepseek Coder v2 has 24 scored results on Noometry and MiMo-V2.5 has 23.

Related comparisons

Go deeper