Noometry

Model comparison

Gemma 4 31B IT vs Ministral 8B

Gemma 4 31B IT is the stronger model overall, scoring 43.5 to 28.2 on the Noometry Index.

Last verified . 15 shared benchmarks.

Gemma 4 31B IT Google

43.5

Rank #90 Confirmed

Ministral 8B Mistral AI

28.2

Rank #325 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Gemma 4 31B IT scores higher in 8 categories and Ministral 8B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemma 4 31B IT leads 37.9 to 12.6.
  • The biggest single-benchmark swing is GPQA Diamond: 75.8% for Gemma 4 31B IT and 27.1% for Ministral 8B.
  • Both cost about the same: $0.09 input and $0.34 output per million tokens.

Side by side

Gemma 4 31B ITMinistral 8B
ProviderGoogleMistral AI
Noometry Index43.528.2
Released2026-04-022024-10-01
WeightsOpenOpen
Context window262K262K
Max output33K262K
Input $ / M tokens$0.09$0.15
Output $ / M tokens$0.34$0.15
Results tracked3517

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 4 31B IT leads

Gemma 4 31B IT: 42.3 (#108), Ministral 8B: 35.0 (#230)

BenchmarkGemma 4 31B ITMinistral 8B
LMArena Coding14591202
LMArena WebDev1366—
SciCode43.4%—
WeirdML52.3%—
ALE-Bench925.5—

Agentic & Tool Use Not comparable

Gemma 4 31B IT: —, Ministral 8B: 16.4 (#148)

BenchmarkGemma 4 31B ITMinistral 8B
Berkeley Function Calling Leaderboard—11.1%

Reasoning Gemma 4 31B IT leads

Gemma 4 31B IT: 27.2 (#122), Ministral 8B: 18.4 (#281)

BenchmarkGemma 4 31B ITMinistral 8B
LMArena Hard Prompts14481191
DTBench82.7%45.7%
Kagi LLM Benchmark63.5%—
NYT Connections (extended)70.6%—
CritPt1.4%—
Chess Puzzles5%—
Thematic Generalization53%—
LMCA39.3%—
Surface Evolver Bench30.6%—
Epoch Capabilities Index142.74—

Math Gemma 4 31B IT leads

Gemma 4 31B IT: 43.2 (#81), Ministral 8B: 25.7 (#267)

BenchmarkGemma 4 31B ITMinistral 8B
LMArena Math14651188
OTIS Mock AIME 2024-202573.3%—
MATH Level 5—14.9%

Knowledge Gemma 4 31B IT leads

Gemma 4 31B IT: 37.9 (#151), Ministral 8B: 12.6 (#297)

BenchmarkGemma 4 31B ITMinistral 8B
GPQA Diamond75.8%27.1%
Vectara Hallucination Rate7.4%7.4%
LMArena Expert14651170
SimpleQA Verified10.4%—

Multimodal Not comparable

Gemma 4 31B IT: 41.6 (#34), Ministral 8B: —

BenchmarkGemma 4 31B ITMinistral 8B
LMArena Vision1277—
LMArena Document1425—

Multilingual Gemma 4 31B IT leads

Gemma 4 31B IT: 53.8 (#57), Ministral 8B: 35.1 (#247)

BenchmarkGemma 4 31B ITMinistral 8B
LMArena Non-English14311165
LMArena Chinese14761193
LMArena Russian14601195
LMArena French1435—
LMArena Spanish1444—

Instruction Following Gemma 4 31B IT leads

Gemma 4 31B IT: 75.5 (#61), Ministral 8B: 60.5 (#250)

BenchmarkGemma 4 31B ITMinistral 8B
LMArena Instruction Following14331161

Long Context Gemma 4 31B IT leads

Gemma 4 31B IT: 44.2 (#71), Ministral 8B: 36.7 (#227)

BenchmarkGemma 4 31B ITMinistral 8B
LMArena Longer Query14461212

Writing & Preference Gemma 4 31B IT leads

Gemma 4 31B IT: 60.5 (#96), Ministral 8B: 39.6 (#246)

BenchmarkGemma 4 31B ITMinistral 8B
LMArena Text14431191
LMArena Creative Writing14151175
LMArena Multi-Turn14521166
EQ-Bench Creative Writing1368—
EQ-Bench 41120—

Frequently asked questions

Is Gemma 4 31B IT better than Ministral 8B?

Gemma 4 31B IT is the stronger model overall, scoring 43.5 to 28.2 on the Noometry Index.

Which is cheaper, Gemma 4 31B IT or Ministral 8B?

Ministral 8B is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Gemma 4 31B IT lists at $0.09 and $0.34.

Is Gemma 4 31B IT or Ministral 8B better for coding?

Gemma 4 31B IT scores higher on coding benchmarks: 42.3 versus 35.0 in the Noometry coding category.

Which has the bigger context window?

Both accept 262K tokens.

How many benchmarks do Gemma 4 31B IT and Ministral 8B share?

15 benchmarks have published results for both models. Gemma 4 31B IT has 35 scored results on Noometry and Ministral 8B has 17.

Related comparisons

Go deeper