Noometry

Model comparison

Gemma 2 9B vs MiniMax-M2.5

MiniMax-M2.5 is the stronger model overall, scoring 38.1 to 25.7 on the Noometry Index.

Last verified . 19 shared benchmarks.

Gemma 2 9B Google

25.7

Rank #334 Confirmed

MiniMax-M2.5 MiniMax

38.1

Rank #181 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemma 2 9B scores higher in 0 categories and MiniMax-M2.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiniMax-M2.5 leads 38.6 to 9.7.

Side by side

Gemma 2 9BMiniMax-M2.5
ProviderGoogleMiniMax
Noometry Index25.738.1
Released2024-06-242026-02-12
WeightsOpenOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked3533

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.5 leads

Gemma 2 9B: 29.0 (#299), MiniMax-M2.5: 47.9 (#53)

BenchmarkGemma 2 9BMiniMax-M2.5
LMArena Coding11741380
SWE-bench Verified (bash only)—75.8%
LMArena WebDev—1386
SWE-bench Multilingual—68.3%
BigCodeBench Instruct34.7%—
LiveBench Coding22.5%—
BigCodeBench Complete40.6%—
ALE-Bench—618.17

Agentic & Tool Use Not comparable

Gemma 2 9B: —, MiniMax-M2.5: 30.2 (#70)

BenchmarkGemma 2 9BMiniMax-M2.5
Terminal-Bench—42.7%
Vending-Bench 2—-23.16

Reasoning MiniMax-M2.5 leads

Gemma 2 9B: 15.3 (#306), MiniMax-M2.5: 17.6 (#281)

BenchmarkGemma 2 9BMiniMax-M2.5
LMArena Hard Prompts11721372
Epoch Capabilities Index119.78146.68
ARC-AGI-2—4.9%
Kagi LLM Benchmark—55.2%
NYT Connections (extended)—16.8%
ARC-AGI-1—63.7%
LiveBench Reasoning15.2%—
LiveBench Data Analysis36.4%—
LiveBench28.7%—
PIQA83.7%—

Math MiniMax-M2.5 leads

Gemma 2 9B: 9.3 (#312), MiniMax-M2.5: 25.8 (#242)

BenchmarkGemma 2 9BMiniMax-M2.5
LMArena Math11831378
OTIS Mock AIME 2024-20250.6%—
ProofBench—4%
LiveBench Math19.8%—
MATH Level 521%—
GSM8K84.9%—

Knowledge MiniMax-M2.5 leads

Gemma 2 9B: 9.7 (#300), MiniMax-M2.5: 38.6 (#132)

BenchmarkGemma 2 9BMiniMax-M2.5
LMArena Expert11471378
GPQA Diamond27.5%—
Vectara Hallucination Rate—9.1%
BoolQ85.7%—
MMLU72.1%—

Multilingual MiniMax-M2.5 leads

Gemma 2 9B: 36.8 (#233), MiniMax-M2.5: 47.3 (#147)

BenchmarkGemma 2 9BMiniMax-M2.5
LMArena Non-English11881338
LMArena Chinese11851392
LMArena French11891363
LMArena German11861361
LMArena Japanese11441169
LMArena Korean11371232
LMArena Russian12001359
LMArena Spanish12001354

Instruction Following MiniMax-M2.5 leads

Gemma 2 9B: 57.8 (#264), MiniMax-M2.5: 71.7 (#143)

BenchmarkGemma 2 9BMiniMax-M2.5
LMArena Instruction Following11781353
LiveBench Instruction Following52.6%—

Long Context MiniMax-M2.5 leads

Gemma 2 9B: 36.3 (#228), MiniMax-M2.5: 37.4 (#211)

BenchmarkGemma 2 9BMiniMax-M2.5
LMArena Longer Query11971367
CL-bench—11.4%
CL-bench Life—6.3%

Writing & Preference MiniMax-M2.5 leads

Gemma 2 9B: 32.3 (#276), MiniMax-M2.5: 54.1 (#149)

BenchmarkGemma 2 9BMiniMax-M2.5
LMArena Text12071359
LMArena Creative Writing12061331
EQ-Bench Creative Writing8411361
LMArena Multi-Turn11931364
LiveBench Language25.5%—

Frequently asked questions

Is Gemma 2 9B better than MiniMax-M2.5?

MiniMax-M2.5 is the stronger model overall, scoring 38.1 to 25.7 on the Noometry Index.

Is Gemma 2 9B or MiniMax-M2.5 better for coding?

MiniMax-M2.5 scores higher on coding benchmarks: 47.9 versus 29.0 in the Noometry coding category.

How many benchmarks do Gemma 2 9B and MiniMax-M2.5 share?

19 benchmarks have published results for both models. Gemma 2 9B has 35 scored results on Noometry and MiniMax-M2.5 has 33.

Related comparisons

Go deeper