Model comparison

Gemma 3 1B vs Mistral Large

Mistral Large is the stronger model overall, scoring 31.9 to 21.1 on the Noometry Index.

Last verified October 10, 2026. 3 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

Mistral Large

Mistral AI

31.9

Rank #263 Confirmed

Summary

They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 1 category and Mistral Large in 3 categories; 4 gaps are clear of the uncertainty.
The widest gap is in knowledge, where Mistral Large leads 30.1 to 7.0.
The biggest single-benchmark swing is GPQA Diamond: 19.9% for Gemma 3 1B and 51.3% for Mistral Large.

Side by side

Gemma 3 1B and Mistral Large specifications
	Gemma 3 1B	Mistral Large
Provider	Google	Mistral AI
Noometry Index	21.1	31.9
Released	2025-03-12	2024-02-26
Weights	Open	Open
Context window	—	131K
Max output	—	16K
Input $ / M tokens	—	$2
Output $ / M tokens	—	$6
Results tracked	4	51

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Mistral Large: 34.3 (#240)

Coding benchmarks
Benchmark	Gemma 3 1B	Mistral Large
SciCode	—	36.2%
BigCodeBench Instruct	—	30%
LiveBench Coding	—	47.1%
LMArena Coding	—	1277
BigCodeBench Complete	—	38.3%
ALE-Bench	—	264.7
HumanEval+	—	62.2%
MBPP+	—	59.5%

Agentic & Tool Use Mistral Large leads

Gemma 3 1B: 13.7 (#152), Mistral Large: 28.6 (#89)

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	Mistral Large
Berkeley Function Calling Leaderboard	7.2%	38.4%

Reasoning Gemma 3 1B leads

Gemma 3 1B: 19.2 (#264), Mistral Large: 15.8 (#310)

Reasoning benchmarks
Benchmark	Gemma 3 1B	Mistral Large
SimpleBench	—	22.5%
CritPt	—	0%
Chess Puzzles	0%	—
LiveBench Reasoning	—	43.5%
LMArena Hard Prompts	—	1257
DTBench	—	65.1%
LiveBench Data Analysis	—	50.1%
LMCA	—	16.7%
Epoch Capabilities Index	—	128.52
ForecastBench	—	57.1
LiveBench	—	48.4%

Math Mistral Large leads

Gemma 3 1B: 10.2 (#316), Mistral Large: 18.2 (#291)

Math benchmarks
Benchmark	Gemma 3 1B	Mistral Large
OTIS Mock AIME 2024-2025	1.1%	8.5%
Omni-MATH	—	28.1%
LiveBench Math	—	42.5%
LMArena Math	—	1262
MATH Level 5	—	50.3%
FrontierMath (Feb 2025 set)	—	0.3%

Knowledge Mistral Large leads

Gemma 3 1B: 7.0 (#314), Mistral Large: 30.1 (#230)

Knowledge benchmarks
Benchmark	Gemma 3 1B	Mistral Large
GPQA Diamond	19.9%	51.3%
MMLU-Pro	—	59.9%
Confabulations	—	21.4%
Vectara Hallucination Rate	—	4.5%
GPQA (HELM)	—	43.5%
LMArena Expert	—	1232
MMLU	—	80%

Multilingual Not comparable

Gemma 3 1B: —, Mistral Large: 40.0 (#219)

Multilingual benchmarks
Benchmark	Gemma 3 1B	Mistral Large
LMArena Non-English	—	1237
LMArena Chinese	—	1240
LMArena French	—	1325
LMArena German	—	1254
LMArena Japanese	—	1188
LMArena Korean	—	1202
LMArena Russian	—	1257
LMArena Spanish	—	1268

Instruction Following Not comparable

Gemma 3 1B: —, Mistral Large: 67.9 (#191)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	Mistral Large
LiveBench Instruction Following	—	67.9%
IFEval	—	87.7%
LMArena Instruction Following	—	1249

Long Context Not comparable

Gemma 3 1B: —, Mistral Large: 38.3 (#199)

Long Context benchmarks
Benchmark	Gemma 3 1B	Mistral Large
LMArena Longer Query	—	1261

Writing & Preference Not comparable

Gemma 3 1B: —, Mistral Large: 40.7 (#242)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	Mistral Large
LMArena Text	—	1266
LMArena Creative Writing	—	1243
Short-Story Creative Writing	—	69%
EQ-Bench Creative Writing	—	985
WildBench	—	80.1%
LMArena Multi-Turn	—	1260
LiveBench Language	—	39.4%

Frequently asked questions

Is Gemma 3 1B better than Mistral Large?