Model comparison

GPT-5.4 mini vs MiMo-V2.5

GPT-5.4 mini is the stronger model overall, scoring 45.0 to 43.4 on the Noometry Index. MiMo-V2.5 costs 9.6× less per token, which makes it the better buy when GPT-5.4 mini's lead doesn't matter for your workload.

Last verified . 23 shared benchmarks.

GPT-5.4 mini OpenAI

45.0

Rank #76 Confirmed

MiMo-V2.5 Xiaomi

43.4

Rank #93 Confirmed

Summary

  • They share 23 benchmarks with published results for both. GPT-5.4 mini scores higher in 6 categories and MiMo-V2.5 in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5.4 mini leads 51.5 to 40.8.
  • The biggest single-benchmark swing is SciCode: 49.9% for GPT-5.4 mini and 43.1% for MiMo-V2.5.
  • MiMo-V2.5 is cheaper at $0.14 / $0.28 per million input/output tokens, against $0.75 / $4.50 for GPT-5.4 mini.
  • MiMo-V2.5 accepts more context: 1.05M tokens versus 400K.
  • MiMo-V2.5 has downloadable open weights; the other is API-only.

Side by side

GPT-5.4 mini and MiMo-V2.5 specifications
GPT-5.4 miniMiMo-V2.5
ProviderOpenAIXiaomi
Noometry Index45.043.4
Released2026-03-172026-04-22
WeightsProprietaryOpen
Context window400K1.05M
Max output128K131K
Input $ / M tokens$0.75$0.14
Output $ / M tokens$4.50$0.28
Results tracked4623

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 mini leads

GPT-5.4 mini: 45.2 (#72), MiMo-V2.5: 43.9 (#81)

Coding benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
LMArena WebDev13971438
SciCode49.9%43.1%
LMArena Coding14381469
ALE-Bench1,189513.95
FrontierCode27%—
WeirdML60.3%—

Agentic & Tool Use Not comparable

GPT-5.4 mini: 29.9 (#81), MiMo-V2.5: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
DeepResearch Bench36.3%—

Reasoning GPT-5.4 mini leads

GPT-5.4 mini: 30.4 (#85), MiMo-V2.5: 28.6 (#101)

Reasoning benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
CritPt10%3.7%
LMArena Hard Prompts14241450
ARC-AGI-218.9%—
Kagi LLM Benchmark37.9%—
NYT Connections (extended)61.8%—
ARC-AGI-163.7%—
Chess Puzzles24%—
Thematic Generalization61.7%—
Mystery Game Puzzles11%—
DTBench80%—
LMCA40.8%—
Epoch Capabilities Index148.84—
ForecastBench57—

Math GPT-5.4 mini leads

GPT-5.4 mini: 45.5 (#75), MiMo-V2.5: 36.8 (#163)

Math benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
ProofBench21%16%
LMArena Math14191436
FrontierMath (Tiers 1-3)51.2%—
FrontierMath Tier 49.8%—
OTIS Mock AIME 2024-202588.9%—
FrontierMath (Feb 2025 set)28.3%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge GPT-5.4 mini leads

GPT-5.4 mini: 51.5 (#67), MiMo-V2.5: 40.8 (#115)

Knowledge benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
LMArena Expert14351460
GPQA Diamond86.9%—
SimpleQA Verified29.4%—
Vectara Hallucination Rate5.5%—

Multimodal Too close to call

GPT-5.4 mini: 39.7 (#56), MiMo-V2.5: 39.8 (#54)

Multimodal benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
LMArena Vision12451247

Multilingual Too close to call

GPT-5.4 mini: 51.9 (#96), MiMo-V2.5: 51.9 (#99)

Multilingual benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
LMArena Non-English14051404
LMArena Chinese14461468
LMArena French14401447
LMArena German14091421
LMArena Japanese13741306
LMArena Korean13681363
LMArena Russian14171395
LMArena Spanish14051416

Instruction Following MiMo-V2.5 leads

GPT-5.4 mini: 74.1 (#102), MiMo-V2.5: 75.5 (#60)

Instruction Following benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
LMArena Instruction Following14051434

Long Context MiMo-V2.5 leads

GPT-5.4 mini: 43.0 (#112), MiMo-V2.5: 44.2 (#73)

Long Context benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
LMArena Longer Query14071445

Writing & Preference GPT-5.4 mini leads

GPT-5.4 mini: 64.0 (#58), MiMo-V2.5: 61.6 (#86)

Writing & Preference benchmarks
BenchmarkGPT-5.4 miniMiMo-V2.5
LMArena Text14121428
LMArena Creative Writing13701393
LMArena Multi-Turn14291445
EQ-Bench Creative Writing1665—

Frequently asked questions

Is GPT-5.4 mini better than MiMo-V2.5?

GPT-5.4 mini is the stronger model overall, scoring 45.0 to 43.4 on the Noometry Index. MiMo-V2.5 costs 9.6× less per token, which makes it the better buy when GPT-5.4 mini's lead doesn't matter for your workload.

Which is cheaper, GPT-5.4 mini or MiMo-V2.5?

MiMo-V2.5 is cheaper. It lists at $0.14 per million input tokens and $0.28 per million output tokens; GPT-5.4 mini lists at $0.75 and $4.50.

Is GPT-5.4 mini or MiMo-V2.5 better for coding?

GPT-5.4 mini scores higher on coding benchmarks: 45.2 versus 43.9 in the Noometry coding category.

Which has the bigger context window?

MiMo-V2.5 does, with 1.05M tokens against 400K.

How many benchmarks do GPT-5.4 mini and MiMo-V2.5 share?

23 benchmarks have published results for both models. GPT-5.4 mini has 46 scored results on Noometry and MiMo-V2.5 has 23.

Related comparisons

Go deeper