Model comparison

DeepSeek-V3 vs MiMo-V2.5

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 39.5 on the Noometry Index.

Last verified . 19 shared benchmarks.

DeepSeek-V3 DeepSeek

39.5

Rank #166 Confirmed

MiMo-V2.5 Xiaomi

43.4

Rank #93 Confirmed

Summary

  • They share 19 benchmarks with published results for both. DeepSeek-V3 scores higher in 0 categories and MiMo-V2.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in long context, where MiMo-V2.5 leads 44.2 to 34.0.
  • The biggest single-benchmark swing is SciCode: 35.8% for DeepSeek-V3 and 43.1% for MiMo-V2.5.
  • MiMo-V2.5 is cheaper at $0.14 / $0.28 per million input/output tokens, against $0.24 / $0.90 for DeepSeek-V3.
  • MiMo-V2.5 accepts more context: 1.05M tokens versus 164K.

Side by side

DeepSeek-V3 and MiMo-V2.5 specifications
DeepSeek-V3MiMo-V2.5
ProviderDeepSeekXiaomi
Noometry Index39.543.4
Released2024-12-262026-04-22
WeightsOpenOpen
Context window164K1.05M
Max output164K131K
Input $ / M tokens$0.24$0.14
Output $ / M tokens$0.90$0.28
Results tracked6023

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2.5 leads

DeepSeek-V3: 42.3 (#106), MiMo-V2.5: 43.9 (#81)

Coding benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
SciCode35.8%43.1%
LMArena Coding13681469
Aider Polyglot55.1%—
LMArena WebDev—1438
WeirdML36.1%—
BigCodeBench Instruct50%—
LiveBench Coding70.9%—
BigCodeBench Complete62.2%—
ALE-Bench—513.95
HumanEval+86.6%—
MBPP+73%—

Agentic & Tool Use Not comparable

DeepSeek-V3: —, MiMo-V2.5: —

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
METR Time Horizons49.6%—

Reasoning MiMo-V2.5 leads

DeepSeek-V3: 20.5 (#236), MiMo-V2.5: 28.6 (#101)

Reasoning benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
CritPt0%3.7%
LMArena Hard Prompts13651450
SimpleBench27.2%—
Kagi LLM Benchmark52.3%—
LiveBench Reasoning65.8%—
DTBench64.8%—
LiveBench Data Analysis60.9%—
LMCA15.5%—
BIG-Bench Hard87.5%—
Epoch Capabilities Index135.94—
ForecastBench59.1—
HellaSwag88.9%—
LiveBench66.9%—
PIQA84.7%—
WinoGrande85.2%—

Math MiMo-V2.5 leads

DeepSeek-V3: 32.1 (#219), MiMo-V2.5: 36.8 (#163)

Math benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
LMArena Math13731436
OTIS Mock AIME 2024-202537.8%—
ProofBench—16%
Omni-MATH40.3%—
LiveBench Math73.5%—
MATH Level 575.5%—
FrontierMath (Feb 2025 set)1.7%—

Knowledge MiMo-V2.5 leads

DeepSeek-V3: 37.5 (#155), MiMo-V2.5: 40.8 (#115)

Knowledge benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
LMArena Expert13511460
GPQA Diamond67.6%—
MMLU-Pro72.3%—
Confabulations26.1%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)53.8%—
ARC (AI2) Challenge95.3%—
MMLU87.2%—
TriviaQA82.9%—

Multimodal Not comparable

DeepSeek-V3: —, MiMo-V2.5: 39.8 (#54)

Multimodal benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
LMArena Vision—1247

Multilingual MiMo-V2.5 leads

DeepSeek-V3: 48.5 (#143), MiMo-V2.5: 51.9 (#99)

Multilingual benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
LMArena Non-English13581404
LMArena Chinese13911468
LMArena French13851447
LMArena German13741421
LMArena Japanese13331306
LMArena Korean13191363
LMArena Russian13731395
LMArena Spanish13581416

Instruction Following MiMo-V2.5 leads

DeepSeek-V3: 72.8 (#130), MiMo-V2.5: 75.5 (#60)

Instruction Following benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
LMArena Instruction Following13451434
LiveBench Instruction Following81.5%—
IFEval83.2%—

Long Context MiMo-V2.5 leads

DeepSeek-V3: 34.0 (#253), MiMo-V2.5: 44.2 (#73)

Long Context benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
LMArena Longer Query13521445
Fiction.LiveBench50%—

Writing & Preference MiMo-V2.5 leads

DeepSeek-V3: 57.4 (#130), MiMo-V2.5: 61.6 (#86)

Writing & Preference benchmarks
BenchmarkDeepSeek-V3MiMo-V2.5
LMArena Text13751428
LMArena Creative Writing13641393
LMArena Multi-Turn13891445
Short-Story Creative Writing77%—
EQ-Bench Creative Writing1472—
WildBench83%—
LiveBench Language49.1%—

Frequently asked questions

Is DeepSeek-V3 better than MiMo-V2.5?

MiMo-V2.5 is the stronger model overall, scoring 43.4 to 39.5 on the Noometry Index.

Which is cheaper, DeepSeek-V3 or MiMo-V2.5?

MiMo-V2.5 is cheaper. It lists at $0.14 per million input tokens and $0.28 per million output tokens; DeepSeek-V3 lists at $0.24 and $0.90.

Is DeepSeek-V3 or MiMo-V2.5 better for coding?

MiMo-V2.5 scores higher on coding benchmarks: 43.9 versus 42.3 in the Noometry coding category.

Which has the bigger context window?

MiMo-V2.5 does, with 1.05M tokens against 164K.

How many benchmarks do DeepSeek-V3 and MiMo-V2.5 share?

19 benchmarks have published results for both models. DeepSeek-V3 has 60 scored results on Noometry and MiMo-V2.5 has 23.

Related comparisons

Go deeper