Model comparison

Gemma 2 9B vs MiMo-V2-Flash

MiMo-V2-Flash is the stronger model overall, scoring 40.8 to 25.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemma 2 9B Google

25.7

Rank #334 Confirmed

MiMo-V2-Flash Xiaomi

40.8

Rank #137 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemma 2 9B scores higher in 0 categories and MiMo-V2-Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiMo-V2-Flash leads 39.1 to 9.7.

Side by side

Gemma 2 9B and MiMo-V2-Flash specifications
Gemma 2 9BMiMo-V2-Flash
ProviderGoogleXiaomi
Noometry Index25.740.8
Released2024-06-242025-12-16
WeightsOpenOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.14
Output $ / M tokens—$0.28
Results tracked3521

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2-Flash leads

Gemma 2 9B: 29.0 (#299), MiMo-V2-Flash: 35.8 (#205)

Coding benchmarks
BenchmarkGemma 2 9BMiMo-V2-Flash
LMArena Coding11741443
LMArena WebDev—1330
SciCode—25.9%
BigCodeBench Instruct34.7%—
LiveBench Coding22.5%—
BigCodeBench Complete40.6%—
ALE-Bench—737.95

Reasoning MiMo-V2-Flash leads

Gemma 2 9B: 15.3 (#306), MiMo-V2-Flash: 24.1 (#155)

Reasoning benchmarks
BenchmarkGemma 2 9BMiMo-V2-Flash
LMArena Hard Prompts11721420
CritPt—0%
LiveBench Reasoning15.2%—
LiveBench Data Analysis36.4%—
Epoch Capabilities Index119.78—
LiveBench28.7%—
PIQA83.7%—

Math MiMo-V2-Flash leads

Gemma 2 9B: 9.3 (#312), MiMo-V2-Flash: 35.6 (#141)

Math benchmarks
BenchmarkGemma 2 9BMiMo-V2-Flash
LMArena Math11831396
OTIS Mock AIME 2024-20250.6%—
LiveBench Math19.8%—
MATH Level 521%—
GSM8K84.9%—

Knowledge MiMo-V2-Flash leads

Gemma 2 9B: 9.7 (#300), MiMo-V2-Flash: 39.1 (#126)

Knowledge benchmarks
BenchmarkGemma 2 9BMiMo-V2-Flash
LMArena Expert11471425
GPQA Diamond27.5%—
BoolQ85.7%—
MMLU72.1%—

Multilingual MiMo-V2-Flash leads

Gemma 2 9B: 36.8 (#233), MiMo-V2-Flash: 51.1 (#109)

Multilingual benchmarks
BenchmarkGemma 2 9BMiMo-V2-Flash
LMArena Non-English11881391
LMArena Chinese11851463
LMArena French11891429
LMArena German11861395
LMArena Japanese11441324
LMArena Korean11371358
LMArena Russian12001387
LMArena Spanish12001420

Instruction Following MiMo-V2-Flash leads

Gemma 2 9B: 57.8 (#264), MiMo-V2-Flash: 73.7 (#115)

Instruction Following benchmarks
BenchmarkGemma 2 9BMiMo-V2-Flash
LMArena Instruction Following11781392
LiveBench Instruction Following52.6%—

Long Context MiMo-V2-Flash leads

Gemma 2 9B: 36.3 (#228), MiMo-V2-Flash: 43.0 (#106)

Long Context benchmarks
BenchmarkGemma 2 9BMiMo-V2-Flash
LMArena Longer Query11971409

Writing & Preference MiMo-V2-Flash leads

Gemma 2 9B: 32.3 (#276), MiMo-V2-Flash: 59.9 (#101)

Writing & Preference benchmarks
BenchmarkGemma 2 9BMiMo-V2-Flash
LMArena Text12071411
LMArena Creative Writing12061375
LMArena Multi-Turn11931404
EQ-Bench Creative Writing841—
LiveBench Language25.5%—

Frequently asked questions

Is Gemma 2 9B better than MiMo-V2-Flash?

MiMo-V2-Flash is the stronger model overall, scoring 40.8 to 25.7 on the Noometry Index.

Is Gemma 2 9B or MiMo-V2-Flash better for coding?

MiMo-V2-Flash scores higher on coding benchmarks: 35.8 versus 29.0 in the Noometry coding category.

How many benchmarks do Gemma 2 9B and MiMo-V2-Flash share?

17 benchmarks have published results for both models. Gemma 2 9B has 35 scored results on Noometry and MiMo-V2-Flash has 21.

Related comparisons

Go deeper