Model comparison

Gemma 2 9B vs MiMo-V2-Pro

MiMo-V2-Pro is the stronger model overall, scoring 43.0 to 25.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemma 2 9B Google

25.9

Rank #341 Confirmed

MiMo-V2-Pro Xiaomi

43.0

Rank #103 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemma 2 9B scores higher in 0 categories and MiMo-V2-Pro in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiMo-V2-Pro leads 41.4 to 9.7.
  • Gemma 2 9B has downloadable open weights; the other is API-only.

Side by side

Gemma 2 9B and MiMo-V2-Pro specifications
Gemma 2 9BMiMo-V2-Pro
ProviderGoogleXiaomi
Noometry Index25.943.0
Released2024-06-242026-03-18
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$0.43
Output $ / M tokens—$0.87
Results tracked3523

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiMo-V2-Pro leads

Gemma 2 9B: 29.4 (#304), MiMo-V2-Pro: 43.8 (#83)

Coding benchmarks
BenchmarkGemma 2 9BMiMo-V2-Pro
LMArena Coding11731476
LMArena WebDev—1433
BigCodeBench Instruct34.7%—
LiveBench Coding22.5%—
BigCodeBench Complete40.6%—
ALE-Bench—785.17

Reasoning MiMo-V2-Pro leads

Gemma 2 9B: 15.9 (#309), MiMo-V2-Pro: 22.1 (#206)

Reasoning benchmarks
BenchmarkGemma 2 9BMiMo-V2-Pro
LMArena Hard Prompts11711457
NYT Connections (extended)—25.8%
Thematic Generalization—45.9%
LiveBench Reasoning15.2%—
LiveBench Data Analysis36.4%—
Epoch Capabilities Index119.83—
LiveBench28.7%—
PIQA83.7%—

Math MiMo-V2-Pro leads

Gemma 2 9B: 9.9 (#318), MiMo-V2-Pro: 39.5 (#102)

Math benchmarks
BenchmarkGemma 2 9BMiMo-V2-Pro
LMArena Math11831447
OTIS Mock AIME 2024-20250.6%—
LiveBench Math19.8%—
MATH Level 521%—
GSM8K84.9%—

Knowledge MiMo-V2-Pro leads

Gemma 2 9B: 9.7 (#305), MiMo-V2-Pro: 41.4 (#111)

Knowledge benchmarks
BenchmarkGemma 2 9BMiMo-V2-Pro
LMArena Expert11471478
GPQA Diamond27.5%—
BoolQ85.7%—
MMLU72.1%—

Multilingual MiMo-V2-Pro leads

Gemma 2 9B: 36.6 (#238), MiMo-V2-Pro: 52.7 (#81)

Multilingual benchmarks
BenchmarkGemma 2 9BMiMo-V2-Pro
LMArena Non-English11881416
LMArena Chinese11851456
LMArena French11901469
LMArena German11861417
LMArena Japanese11441366
LMArena Korean11371400
LMArena Russian12001427
LMArena Spanish12001457

Instruction Following MiMo-V2-Pro leads

Gemma 2 9B: 57.6 (#269), MiMo-V2-Pro: 76.0 (#49)

Instruction Following benchmarks
BenchmarkGemma 2 9BMiMo-V2-Pro
LMArena Instruction Following11781445
LiveBench Instruction Following52.6%—

Long Context MiMo-V2-Pro leads

Gemma 2 9B: 36.3 (#233), MiMo-V2-Pro: 41.5 (#138)

Long Context benchmarks
BenchmarkGemma 2 9BMiMo-V2-Pro
LMArena Longer Query11971455
CL-bench—15.7%
CL-bench Life—6.9%

Writing & Preference MiMo-V2-Pro leads

Gemma 2 9B: 32.1 (#281), MiMo-V2-Pro: 62.8 (#70)

Writing & Preference benchmarks
BenchmarkGemma 2 9BMiMo-V2-Pro
LMArena Text12071436
LMArena Creative Writing12061415
LMArena Multi-Turn11931456
EQ-Bench Creative Writing841—
LiveBench Language25.5%—

Frequently asked questions

Is Gemma 2 9B better than MiMo-V2-Pro?

MiMo-V2-Pro is the stronger model overall, scoring 43.0 to 25.9 on the Noometry Index.

Is Gemma 2 9B or MiMo-V2-Pro better for coding?

MiMo-V2-Pro scores higher on coding benchmarks: 43.8 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2 9B and MiMo-V2-Pro share?

17 benchmarks have published results for both models. Gemma 2 9B has 35 scored results on Noometry and MiMo-V2-Pro has 23.

Related comparisons

Go deeper