Noometry

Model comparison

Gemma 3 4B vs MiMo-V2-Flash

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 28.1 on the Noometry Index. Gemma 3 4B costs 3.5× less per token, which makes it the better buy when MiMo-V2-Flash's lead doesn't matter for your workload.

Last verified . 12 shared benchmarks.

Gemma 3 4B Google

28.1

Rank #326 Confirmed

MiMo-V2-Flash Xiaomi

41.3

Rank #138 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemma 3 4B scores higher in 0 categories and MiMo-V2-Flash in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiMo-V2-Flash leads 39.7 to 11.8.
  • Gemma 3 4B is cheaper at $0.04 / $0.08 per million input/output tokens, against $0.14 / $0.28 for MiMo-V2-Flash.
  • MiMo-V2-Flash accepts more context: 262K tokens versus 131K.

Side by side

Gemma 3 4BMiMo-V2-Flash
ProviderGoogleXiaomi
Noometry Index28.141.3
Released2025-03-122025-12-16
WeightsOpenOpen
Context window131K262K
Max output4K66K
Input $ / M tokens$0.04$0.14
Output $ / M tokens$0.08$0.28
Results tracked2221

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemma 3 4B: 35.9 (#215), MiMo-V2-Flash: 36.1 (#211)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Coding12301443
LMArena WebDev—1330
SciCode—25.9%
ALE-Bench—737.95

Agentic & Tool Use Not comparable

Gemma 3 4B: 20.9 (#142), MiMo-V2-Flash: —

BenchmarkGemma 3 4BMiMo-V2-Flash
Berkeley Function Calling Leaderboard19.6%—

Reasoning MiMo-V2-Flash leads

Gemma 3 4B: 13.2 (#335), MiMo-V2-Flash: 24.9 (#157)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Hard Prompts12531420
Kagi LLM Benchmark25.2%—
CritPt—0%
Chess Puzzles0%—
DTBench50.9%—
LMCA2.8%—
Epoch Capabilities Index116.02—

Math MiMo-V2-Flash leads

Gemma 3 4B: 16.8 (#292), MiMo-V2-Flash: 38.3 (#139)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Math12391396
OTIS Mock AIME 2024-20257.5%—

Knowledge MiMo-V2-Flash leads

Gemma 3 4B: 11.8 (#299), MiMo-V2-Flash: 39.7 (#131)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Expert12231425
GPQA Diamond23.2%—
Vectara Hallucination Rate6.4%—

Multilingual MiMo-V2-Flash leads

Gemma 3 4B: 42.5 (#194), MiMo-V2-Flash: 51.0 (#113)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Non-English12731392
LMArena German12811395
LMArena Russian12941387
LMArena Chinese—1462
LMArena French—1429
LMArena Japanese—1325
LMArena Korean—1358
LMArena Spanish—1420

Instruction Following MiMo-V2-Flash leads

Gemma 3 4B: 65.2 (#225), MiMo-V2-Flash: 73.5 (#120)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Instruction Following12391392

Long Context MiMo-V2-Flash leads

Gemma 3 4B: 38.7 (#194), MiMo-V2-Flash: 43.0 (#110)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Longer Query12731409

Writing & Preference MiMo-V2-Flash leads

Gemma 3 4B: 42.0 (#239), MiMo-V2-Flash: 59.7 (#106)

BenchmarkGemma 3 4BMiMo-V2-Flash
LMArena Text12911411
LMArena Creative Writing12711375
LMArena Multi-Turn12551404
EQ-Bench Creative Writing1068—

Frequently asked questions

Is Gemma 3 4B better than MiMo-V2-Flash?

MiMo-V2-Flash is the stronger model overall, scoring 41.3 to 28.1 on the Noometry Index. Gemma 3 4B costs 3.5× less per token, which makes it the better buy when MiMo-V2-Flash's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 4B or MiMo-V2-Flash?

Gemma 3 4B is cheaper. It lists at $0.04 per million input tokens and $0.08 per million output tokens; MiMo-V2-Flash lists at $0.14 and $0.28.

Is Gemma 3 4B or MiMo-V2-Flash better for coding?

They score almost the same on coding (35.9 vs 36.1); test both on your own repository before choosing.

Which has the bigger context window?

MiMo-V2-Flash does, with 262K tokens against 131K.

How many benchmarks do Gemma 3 4B and MiMo-V2-Flash share?

12 benchmarks have published results for both models. Gemma 3 4B has 22 scored results on Noometry and MiMo-V2-Flash has 21.

Related comparisons

Go deeper