Model comparison

Gemma 3 1B vs MiMo-V2.5-Pro

MiMo-V2.5-Pro is the stronger model overall, scoring 44.8 to 20.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 3 1B Google

20.7

Rank #348 Reported

MiMo-V2.5-Pro Xiaomi

44.8

Rank #70 Confirmed

Summary

  • The widest gap is in knowledge, where MiMo-V2.5-Pro leads 41.5 to 7.1.

Side by side

Gemma 3 1B and MiMo-V2.5-Pro specifications
Gemma 3 1BMiMo-V2.5-Pro
ProviderGoogleXiaomi
Noometry Index20.744.8
Released2025-03-122026-04-22
WeightsOpenOpen
Context window—1.05M
Max output—131K
Input $ / M tokens—$0.43
Output $ / M tokens—$0.87
Results tracked427

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, MiMo-V2.5-Pro: 47.0 (#58)

Coding benchmarks
BenchmarkGemma 3 1BMiMo-V2.5-Pro
LMArena WebDev—1477
SciCode—50.2%
LMArena Coding—1502
ALE-Bench—899.8

Agentic & Tool Use Not comparable

Gemma 3 1B: 13.5 (#144), MiMo-V2.5-Pro: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 1BMiMo-V2.5-Pro
Berkeley Function Calling Leaderboard7.2%—

Reasoning MiMo-V2.5-Pro leads

Gemma 3 1B: 18.5 (#260), MiMo-V2.5-Pro: 25.9 (#124)

Reasoning benchmarks
BenchmarkGemma 3 1BMiMo-V2.5-Pro
NYT Connections (extended)—34.4%
CritPt—4%
Chess Puzzles0%—
LMArena Hard Prompts—1487
DTBench—84.5%
LMCA—29.5%

Math MiMo-V2.5-Pro leads

Gemma 3 1B: 9.6 (#310), MiMo-V2.5-Pro: 38.6 (#84)

Math benchmarks
BenchmarkGemma 3 1BMiMo-V2.5-Pro
OTIS Mock AIME 2024-20251.1%—
ProofBench—22%
LMArena Math—1480

Knowledge MiMo-V2.5-Pro leads

Gemma 3 1B: 7.1 (#309), MiMo-V2.5-Pro: 41.5 (#100)

Knowledge benchmarks
BenchmarkGemma 3 1BMiMo-V2.5-Pro
GPQA Diamond19.9%—
LMArena Expert—1501

Multilingual Not comparable

Gemma 3 1B: —, MiMo-V2.5-Pro: 55.3 (#33)

Multilingual benchmarks
BenchmarkGemma 3 1BMiMo-V2.5-Pro
LMArena Non-English—1449
LMArena Chinese—1507
LMArena French—1489
LMArena German—1455
LMArena Japanese—1418
LMArena Korean—1436
LMArena Russian—1450
LMArena Spanish—1470

Instruction Following Not comparable

Gemma 3 1B: —, MiMo-V2.5-Pro: 77.6 (#21)

Instruction Following benchmarks
BenchmarkGemma 3 1BMiMo-V2.5-Pro
LMArena Instruction Following—1477

Long Context Not comparable

Gemma 3 1B: —, MiMo-V2.5-Pro: 45.4 (#38)

Long Context benchmarks
BenchmarkGemma 3 1BMiMo-V2.5-Pro
LMArena Longer Query—1482

Writing & Preference Not comparable

Gemma 3 1B: —, MiMo-V2.5-Pro: 65.5 (#47)

Writing & Preference benchmarks
BenchmarkGemma 3 1BMiMo-V2.5-Pro
LMArena Text—1465
LMArena Creative Writing—1440
EQ-Bench Creative Writing—1493
EQ-Bench 4—1208
LMArena Multi-Turn—1477

Frequently asked questions

Is Gemma 3 1B better than MiMo-V2.5-Pro?

MiMo-V2.5-Pro is the stronger model overall, scoring 44.8 to 20.7 on the Noometry Index.

How many benchmarks do Gemma 3 1B and MiMo-V2.5-Pro share?

0 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and MiMo-V2.5-Pro has 27.

Related comparisons

Go deeper