Model comparison

GPT-4o mini vs MiMo-V2.6-Flash

MiMo-V2.6-Flash is the stronger model overall, scoring 48.5 to 25.5 on the Noometry Index.

Last verified . 15 shared benchmarks.

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

MiMo-V2.6-Flash Xiaomi

48.5

Rank #55 Confirmed

Summary

  • They share 15 benchmarks with published results for both. GPT-4o mini scores higher in 0 categories and MiMo-V2.6-Flash in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where MiMo-V2.6-Flash leads 51.9 to 10.4.
  • MiMo-V2.6-Flash is cheaper at $0.14 / $0.28 per million input/output tokens, against $0.15 / $0.60 for GPT-4o mini.
  • MiMo-V2.6-Flash accepts more context: 1.05M tokens versus 128K.
  • MiMo-V2.6-Flash has downloadable open weights; the other is API-only.

Side by side

GPT-4o mini and MiMo-V2.6-Flash specifications
GPT-4o miniMiMo-V2.6-Flash
ProviderOpenAIXiaomi
Noometry Index25.548.5
Released2024-07-182026-09-21
WeightsProprietaryOpen
Context window128K1.05M
Max output16K131K
Input $ / M tokens$0.15$0.14
Output $ / M tokens$0.60$0.28
Results tracked6019

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2.6-Flash leads

GPT-4o mini: 22.0 (#335), MiMo-V2.6-Flash: 53.4 (#30)

Coding benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
LMArena Coding12901504
Aider Polyglot3.6%—
LMArena WebDev—1637
SciCode—51.3%
WeirdML11.8%—
BigCodeBench Instruct46.1%—
LiveBench Coding43.1%—
BigCodeBench Complete57.4%—
HumanEval+83.5%—
MBPP+72.2%—

Agentic & Tool Use Not comparable

GPT-4o mini: 27.5 (#101), MiMo-V2.6-Flash: —

Agentic & Tool Use benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
BALROG17.4%—

Reasoning MiMo-V2.6-Flash leads

GPT-4o mini: 8.7 (#347), MiMo-V2.6-Flash: 36.5 (#66)

Reasoning benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
LMArena Hard Prompts12671482
ARC-AGI-20%—
SimpleBench10.7%—
Kagi LLM Benchmark28.8%—
CritPt—12%
Chess Puzzles0%—
LiveBench Reasoning32.8%—
Mystery Game Puzzles12%—
DTBench54.4%—
LiveBench Data Analysis50%—
LMCA10.4%—
Epoch Capabilities Index126.56—
LiveBench41.3%—
PIQA88.7%—

Math MiMo-V2.6-Flash leads

GPT-4o mini: 10.4 (#314), MiMo-V2.6-Flash: 51.9 (#52)

Math benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
LMArena Math12671468
FrontierMath (Tiers 1-3)0.7%—
OTIS Mock AIME 2024-20256.9%—
ProofBench—63%
Omni-MATH28%—
LiveBench Math36.3%—
MATH Level 552.6%—
GSM8K91.3%—

Knowledge MiMo-V2.6-Flash leads

GPT-4o mini: 17.7 (#284), MiMo-V2.6-Flash: 42.2 (#99)

Knowledge benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
LMArena Expert12351501
GPQA Diamond37.7%—
SimpleQA Verified8.3%—
MMLU-Pro60.3%—
Confabulations37.2%—
GPQA (HELM)36.8%—
BoolQ88.7%—
MMLU81.8%—

Multimodal MiMo-V2.6-Flash leads

GPT-4o mini: 25.9 (#122), MiMo-V2.6-Flash: 40.5 (#47)

Multimodal benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
LMArena Vision10661259
Video-MME64.8%—
GeoBench64%—
VPCT34%—

Multilingual MiMo-V2.6-Flash leads

GPT-4o mini: 42.0 (#199), MiMo-V2.6-Flash: 54.0 (#51)

Multilingual benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
LMArena Non-English12661434
LMArena Chinese12651511
LMArena French12971475
LMArena Russian12751409
LMArena Spanish12761456
LMArena German1272—
LMArena Japanese1216—
LMArena Korean1195—

Instruction Following MiMo-V2.6-Flash leads

GPT-4o mini: 61.9 (#239), MiMo-V2.6-Flash: 76.8 (#35)

Instruction Following benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
LMArena Instruction Following12581463
LiveBench Instruction Following56.8%—
IFEval78.2%—

Long Context MiMo-V2.6-Flash leads

GPT-4o mini: 39.1 (#186), MiMo-V2.6-Flash: 44.8 (#57)

Long Context benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
LMArena Longer Query12891463

Writing & Preference MiMo-V2.6-Flash leads

GPT-4o mini: 39.5 (#248), MiMo-V2.6-Flash: 63.1 (#67)

Writing & Preference benchmarks
BenchmarkGPT-4o miniMiMo-V2.6-Flash
LMArena Text12861455
LMArena Creative Writing12681400
LMArena Multi-Turn12851451
Short-Story Creative Writing67.2%—
EQ-Bench Creative Writing873—
WildBench79.1%—
LiveBench Language28.6%—

Frequently asked questions

Is GPT-4o mini better than MiMo-V2.6-Flash?

MiMo-V2.6-Flash is the stronger model overall, scoring 48.5 to 25.5 on the Noometry Index.

Which is cheaper, GPT-4o mini or MiMo-V2.6-Flash?

MiMo-V2.6-Flash is cheaper. It lists at $0.14 per million input tokens and $0.28 per million output tokens; GPT-4o mini lists at $0.15 and $0.60.

Is GPT-4o mini or MiMo-V2.6-Flash better for coding?

MiMo-V2.6-Flash scores higher on coding benchmarks: 53.4 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

MiMo-V2.6-Flash does, with 1.05M tokens against 128K.

How many benchmarks do GPT-4o mini and MiMo-V2.6-Flash share?

15 benchmarks have published results for both models. GPT-4o mini has 60 scored results on Noometry and MiMo-V2.6-Flash has 19.

Related comparisons

Go deeper