Model comparison

Gemma 3 1B vs Mistral Small

Mistral Small is the stronger model overall, scoring 33.4 to 21.1 on the Noometry Index.

Last verified October 10, 2026. 3 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

Mistral Small

Mistral AI

33.4

Rank #243 Confirmed

Summary

They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and Mistral Small in 4 categories; 3 gaps are clear of the uncertainty.
The widest gap is in knowledge, where Mistral Small leads 31.0 to 7.0.
The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 7.2% for Gemma 3 1B and 37.1% for Mistral Small.

Side by side

Gemma 3 1B and Mistral Small specifications
	Gemma 3 1B	Mistral Small
Provider	Google	Mistral AI
Noometry Index	21.1	33.4
Released	2025-03-12	2024-02-26
Weights	Open	Open
Context window	—	262K
Max output	—	256K
Input $ / M tokens	—	$0.15
Output $ / M tokens	—	$0.60
Results tracked	4	39

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Mistral Small: 34.0 (#247)

Coding benchmarks
Benchmark	Gemma 3 1B	Mistral Small
SciCode	—	26.5%
BigCodeBench Instruct	—	36.1%
LiveBench Coding	—	36.2%
LMArena Coding	—	1362
BigCodeBench Complete	—	46.6%
ALE-Bench	—	497.62

Agentic & Tool Use Mistral Small leads

Gemma 3 1B: 13.7 (#152), Mistral Small: 28.1 (#93)

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	Mistral Small
Berkeley Function Calling Leaderboard	7.2%	37.1%

Reasoning Too close to call

Gemma 3 1B: 19.2 (#264), Mistral Small: 19.8 (#250)

Reasoning benchmarks
Benchmark	Gemma 3 1B	Mistral Small
Kagi LLM Benchmark	—	37.8%
CritPt	—	0%
Chess Puzzles	0%	—
LiveBench Reasoning	—	44.8%
LMArena Hard Prompts	—	1335
DTBench	—	70.9%
LiveBench Data Analysis	—	53.7%
LMCA	—	20.6%
LiveBench	—	44%

Math Mistral Small leads

Gemma 3 1B: 10.2 (#316), Mistral Small: 16.4 (#293)

Math benchmarks
Benchmark	Gemma 3 1B	Mistral Small
OTIS Mock AIME 2024-2025	1.1%	5.8%
LiveBench Math	—	39.9%
LMArena Math	—	1341
MATH Level 5	—	46.8%

Knowledge Mistral Small leads

Gemma 3 1B: 7.0 (#314), Mistral Small: 31.0 (#222)

Knowledge benchmarks
Benchmark	Gemma 3 1B	Mistral Small
GPQA Diamond	19.9%	47.5%
Vectara Hallucination Rate	—	5.1%
LMArena Expert	—	1291
MMLU	—	68.7%

Multimodal Not comparable

Gemma 3 1B: —, Mistral Small: 33.5 (#96)

Multimodal benchmarks
Benchmark	Gemma 3 1B	Mistral Small
LMArena Vision	—	1142

Multilingual Not comparable

Gemma 3 1B: —, Mistral Small: 45.5 (#169)

Multilingual benchmarks
Benchmark	Gemma 3 1B	Mistral Small
LMArena Non-English	—	1315
LMArena Chinese	—	1340
LMArena French	—	1337
LMArena German	—	1340
LMArena Japanese	—	1275
LMArena Korean	—	1259
LMArena Russian	—	1324
LMArena Spanish	—	1346

Instruction Following Not comparable

Gemma 3 1B: —, Mistral Small: 66.4 (#209)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	Mistral Small
LiveBench Instruction Following	—	63.7%
LMArena Instruction Following	—	1310

Long Context Not comparable

Gemma 3 1B: —, Mistral Small: 40.4 (#156)

Long Context benchmarks
Benchmark	Gemma 3 1B	Mistral Small
LMArena Longer Query	—	1327

Writing & Preference Not comparable

Gemma 3 1B: —, Mistral Small: 52.5 (#171)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	Mistral Small
LMArena Text	—	1338
LMArena Creative Writing	—	1305
LMArena Multi-Turn	—	1344
LiveBench Language	—	30.5%

Frequently asked questions

Is Gemma 3 1B better than Mistral Small?