Model comparison

Gemma 3 1B vs Mistral Medium

Mistral Medium is the stronger model overall, scoring 36.3 to 21.1 on the Noometry Index.

Last verified October 10, 2026. 3 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

Mistral Medium

Mistral AI

36.3

Rank #218 Confirmed

Summary

They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and Mistral Medium in 4 categories; 4 gaps are clear of the uncertainty.
The widest gap is in knowledge, where Mistral Medium leads 25.0 to 7.0.
The biggest single-benchmark swing is GPQA Diamond: 19.9% for Gemma 3 1B and 59.5% for Mistral Medium.

Side by side

Gemma 3 1B and Mistral Medium specifications
	Gemma 3 1B	Mistral Medium
Provider	Google	Mistral AI
Noometry Index	21.1	36.3
Released	2025-03-12	2023-12-11
Weights	Open	Open
Context window	—	262K
Max output	—	262K
Input $ / M tokens	—	$1.50
Output $ / M tokens	—	$7.50
Results tracked	4	36

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Mistral Medium: 34.2 (#243)

Coding benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
FrontierCode	—	8%
SciCode	—	40.2%
WeirdML	—	43.7%
LMArena Coding	—	1434
ALE-Bench	—	763.98

Agentic & Tool Use Mistral Medium leads

Gemma 3 1B: 13.7 (#152), Mistral Medium: 28.3 (#90)

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
Berkeley Function Calling Leaderboard	7.2%	37.7%

Reasoning Mistral Medium leads

Gemma 3 1B: 19.2 (#264), Mistral Medium: 24.0 (#167)

Reasoning benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
Kagi LLM Benchmark	—	50%
CritPt	—	0%
Chess Puzzles	0%	—
LMArena Hard Prompts	—	1426
DTBench	—	75.5%
LMCA	—	26.1%
Surface Evolver Bench	—	26.9%

Math Mistral Medium leads

Gemma 3 1B: 10.2 (#316), Mistral Medium: 28.1 (#245)

Math benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
OTIS Mock AIME 2024-2025	1.1%	32.2%
ProofBench	—	9%
LMArena Math	—	1408
MATH Level 5	—	81.6%
FrontierMath (Feb 2025 set)	—	0.3%

Knowledge Mistral Medium leads

Gemma 3 1B: 7.0 (#314), Mistral Medium: 25.0 (#265)

Knowledge benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
GPQA Diamond	19.9%	59.5%
Humanity's Last Exam	—	4.5%
Vectara Hallucination Rate	—	22.7%
LMArena Expert	—	1408

Multimodal Not comparable

Gemma 3 1B: —, Mistral Medium: 35.3 (#88)

Multimodal benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
LMArena Vision	—	1172

Multilingual Not comparable

Gemma 3 1B: —, Mistral Medium: 52.1 (#91)

Multilingual benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
LMArena Non-English	—	1408
LMArena Chinese	—	1447
LMArena French	—	1459
LMArena German	—	1432
LMArena Japanese	—	1378
LMArena Korean	—	1380
LMArena Russian	—	1411
LMArena Spanish	—	1433

Instruction Following Not comparable

Gemma 3 1B: —, Mistral Medium: 73.7 (#116)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
LMArena Instruction Following	—	1398

Long Context Not comparable

Gemma 3 1B: —, Mistral Medium: 42.9 (#114)

Long Context benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
LMArena Longer Query	—	1406

Writing & Preference Not comparable

Gemma 3 1B: —, Mistral Medium: 60.0 (#103)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	Mistral Medium
LMArena Text	—	1424
LMArena Creative Writing	—	1391
Short-Story Creative Writing	—	77.3%
LMArena Multi-Turn	—	1418

Frequently asked questions

Is Gemma 3 1B better than Mistral Medium?