Model comparison

Gemma 4 31B IT vs MiniMax-M3

Gemma 4 31B IT and MiniMax-M3 score almost the same on the Noometry Index (43.5 vs 43.8), so choose on price, context window or the category you care about most.

Last verified . 29 shared benchmarks.

Gemma 4 31B IT Google

43.5

Rank #90 Confirmed

MiniMax-M3 MiniMax

43.8

Rank #85 Confirmed

Summary

  • They share 29 benchmarks with published results for both. Gemma 4 31B IT scores higher in 5 categories and MiniMax-M3 in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiniMax-M3 leads 58.4 to 37.9.
  • The biggest single-benchmark swing is Surface Evolver Bench: 30.6% for Gemma 4 31B IT and 55% for MiniMax-M3.
  • Gemma 4 31B IT is cheaper at $0.09 / $0.34 per million input/output tokens, against $0.30 / $1.20 for MiniMax-M3.
  • MiniMax-M3 accepts more context: 1M tokens versus 262K.

Side by side

Gemma 4 31B IT and MiniMax-M3 specifications
Gemma 4 31B ITMiniMax-M3
ProviderGoogleMiniMax
Noometry Index43.543.8
Released2026-04-022026-06-01
WeightsOpenOpen
Context window262K1M
Max output33K512K
Input $ / M tokens$0.09$0.30
Output $ / M tokens$0.34$1.20
Results tracked3541

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemma 4 31B IT: 42.3 (#108), MiniMax-M3: 41.8 (#118)

Coding benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
LMArena WebDev13661482
SciCode43.4%47.1%
LMArena Coding14591469
ALE-Bench925.5640.02
FrontierCode—14.7%
WeirdML52.3%—

Agentic & Tool Use Not comparable

Gemma 4 31B IT: —, MiniMax-M3: 22.6 (#130)

Agentic & Tool Use benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
APEX-Agents—37.7%
OSWorld 2.0—4.6%
GBAEval—0.9%
Vending-Bench 2—2,158

Reasoning MiniMax-M3 leads

Gemma 4 31B IT: 27.2 (#122), MiniMax-M3: 30.1 (#87)

Reasoning benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
NYT Connections (extended)70.6%65.1%
CritPt1.4%3.7%
Chess Puzzles5%14%
LMArena Hard Prompts14481447
DTBench82.7%78.9%
LMCA39.3%33.7%
Surface Evolver Bench30.6%55%
Epoch Capabilities Index142.74146.95
SimpleBench—45.8%
Kagi LLM Benchmark63.5%—
Thematic Generalization53%—
Mystery Game Puzzles—8%
ForecastBench—61.4

Math Gemma 4 31B IT leads

Gemma 4 31B IT: 43.2 (#81), MiniMax-M3: 40.0 (#95)

Math benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
OTIS Mock AIME 2024-202573.3%71.1%
LMArena Math14651429
ProofBench—18%

Knowledge MiniMax-M3 leads

Gemma 4 31B IT: 37.9 (#151), MiniMax-M3: 58.4 (#35)

Knowledge benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
GPQA Diamond75.8%90.9%
LMArena Expert14651461
SimpleQA Verified10.4%—
Vectara Hallucination Rate7.4%—

Multimodal Gemma 4 31B IT leads

Gemma 4 31B IT: 41.6 (#34), MiniMax-M3: 40.2 (#51)

Multimodal benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
LMArena Vision12771253
LMArena Document14251435

Multilingual Too close to call

Gemma 4 31B IT: 53.8 (#57), MiniMax-M3: 53.0 (#75)

Multilingual benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
LMArena Non-English14311420
LMArena Chinese14761463
LMArena French14351447
LMArena Russian14601428
LMArena Spanish14441432
LMArena German—1426
LMArena Japanese—1381
LMArena Korean—1372

Instruction Following Too close to call

Gemma 4 31B IT: 75.5 (#61), MiniMax-M3: 75.5 (#62)

Instruction Following benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
LMArena Instruction Following14331433

Long Context Too close to call

Gemma 4 31B IT: 44.2 (#71), MiniMax-M3: 44.2 (#72)

Long Context benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
LMArena Longer Query14461445

Writing & Preference MiniMax-M3 leads

Gemma 4 31B IT: 60.5 (#96), MiniMax-M3: 62.1 (#83)

Writing & Preference benchmarks
BenchmarkGemma 4 31B ITMiniMax-M3
LMArena Text14431433
LMArena Creative Writing14151404
EQ-Bench 411201150
LMArena Multi-Turn14521442
EQ-Bench Creative Writing1368—

Frequently asked questions

Is Gemma 4 31B IT better than MiniMax-M3?

Gemma 4 31B IT and MiniMax-M3 score almost the same on the Noometry Index (43.5 vs 43.8), so choose on price, context window or the category you care about most.

Which is cheaper, Gemma 4 31B IT or MiniMax-M3?

Gemma 4 31B IT is cheaper. It lists at $0.09 per million input tokens and $0.34 per million output tokens; MiniMax-M3 lists at $0.30 and $1.20.

Is Gemma 4 31B IT or MiniMax-M3 better for coding?

They score almost the same on coding (42.3 vs 41.8); test both on your own repository before choosing.

Which has the bigger context window?

MiniMax-M3 does, with 1M tokens against 262K.

How many benchmarks do Gemma 4 31B IT and MiniMax-M3 share?

29 benchmarks have published results for both models. Gemma 4 31B IT has 35 scored results on Noometry and MiniMax-M3 has 41.

Related comparisons

Go deeper