Model comparison

Deepseek Coder v2 vs MiMo-V2.5-Pro

MiMo-V2.5-Pro is the stronger model overall, scoring 45.2 to 35.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Deepseek Coder v2 DeepSeek

35.9

Rank #220 Confirmed

MiMo-V2.5-Pro Xiaomi

45.2

Rank #74 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Deepseek Coder v2 scores higher in 0 categories and MiMo-V2.5-Pro in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiMo-V2.5-Pro leads 65.3 to 38.2.

Side by side

Deepseek Coder v2 and MiMo-V2.5-Pro specifications
Deepseek Coder v2MiMo-V2.5-Pro
ProviderDeepSeekXiaomi
Noometry Index35.945.2
Released2024-06-172026-04-22
WeightsOpenOpen
Context window—1.05M
Max output—131K
Input $ / M tokens—$0.43
Output $ / M tokens—$0.87
Results tracked2427

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2.5-Pro leads

Deepseek Coder v2: 38.1 (#183), MiMo-V2.5-Pro: 47.4 (#60)

Coding benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5-Pro
LMArena Coding12511503
LMArena WebDev—1479
SciCode—50.2%
BigCodeBench Instruct48.2%—
BigCodeBench Complete59.7%—
ALE-Bench—899.8
HumanEval+82.3%—
MBPP+75.1%—

Reasoning MiMo-V2.5-Pro leads

Deepseek Coder v2: 23.6 (#176), MiMo-V2.5-Pro: 26.8 (#130)

Reasoning benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5-Pro
LMArena Hard Prompts12071488
NYT Connections (extended)—34.4%
CritPt—4%
DTBench—84.5%
LMCA—29.5%
WinoGrande83.7%—

Math MiMo-V2.5-Pro leads

Deepseek Coder v2: 34.9 (#190), MiMo-V2.5-Pro: 40.0 (#96)

Math benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5-Pro
LMArena Math12411481
ProofBench—22%
GSM8K94.5%—

Knowledge MiMo-V2.5-Pro leads

Deepseek Coder v2: 32.3 (#212), MiMo-V2.5-Pro: 42.2 (#98)

Knowledge benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5-Pro
LMArena Expert11811503
ARC (AI2) Challenge64.3%—

Multilingual MiMo-V2.5-Pro leads

Deepseek Coder v2: 36.3 (#240), MiMo-V2.5-Pro: 55.1 (#34)

Multilingual benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5-Pro
LMArena Non-English11821449
LMArena Chinese12011507
LMArena French11851488
LMArena German11641458
LMArena Japanese11261412
LMArena Korean11041437
LMArena Russian11881450
LMArena Spanish11531471

Instruction Following MiMo-V2.5-Pro leads

Deepseek Coder v2: 61.7 (#242), MiMo-V2.5-Pro: 77.5 (#21)

Instruction Following benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5-Pro
LMArena Instruction Following11801477

Long Context MiMo-V2.5-Pro leads

Deepseek Coder v2: 37.0 (#224), MiMo-V2.5-Pro: 45.4 (#37)

Long Context benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5-Pro
LMArena Longer Query12191483

Writing & Preference MiMo-V2.5-Pro leads

Deepseek Coder v2: 38.2 (#253), MiMo-V2.5-Pro: 65.3 (#49)

Writing & Preference benchmarks
BenchmarkDeepseek Coder v2MiMo-V2.5-Pro
LMArena Text11911465
LMArena Creative Writing11201440
LMArena Multi-Turn11771477
EQ-Bench Creative Writing—1493
EQ-Bench 4—1208

Frequently asked questions

Is Deepseek Coder v2 better than MiMo-V2.5-Pro?

MiMo-V2.5-Pro is the stronger model overall, scoring 45.2 to 35.9 on the Noometry Index.

Is Deepseek Coder v2 or MiMo-V2.5-Pro better for coding?

MiMo-V2.5-Pro scores higher on coding benchmarks: 47.4 versus 38.1 in the Noometry coding category.

How many benchmarks do Deepseek Coder v2 and MiMo-V2.5-Pro share?

17 benchmarks have published results for both models. Deepseek Coder v2 has 24 scored results on Noometry and MiMo-V2.5-Pro has 27.

Related comparisons

Go deeper