Model comparison

Gemma 3 1B vs Mistral Medium 3.5

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 21.1 on the Noometry Index.

Last verified October 11, 2026. 0 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

Mistral Medium 3.5

Mistral AI

40.2

Rank #152 Confirmed

Summary

The widest gap is in knowledge, where Mistral Medium 3.5 leads 40.0 to 7.0.

Side by side

Gemma 3 1B and Mistral Medium 3.5 specifications
	Gemma 3 1B	Mistral Medium 3.5
Provider	Google	Mistral AI
Noometry Index	21.1	40.2
Released	2025-03-12	—
Weights	Open	Open
Context window	—	262K
Max output	—	210K
Input $ / M tokens	—	$1.50
Output $ / M tokens	—	$7.50
Results tracked	4	22

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Mistral Medium 3.5: 36.0 (#213)

Coding benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
LMArena WebDev	—	1264
LMArena Coding	—	1461

Agentic & Tool Use Not comparable

Gemma 3 1B: 13.7 (#152), Mistral Medium 3.5: —

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
Berkeley Function Calling Leaderboard	7.2%	—

Reasoning Gemma 3 1B leads

Gemma 3 1B: 19.2 (#264), Mistral Medium 3.5: 17.3 (#295)

Reasoning benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
Kagi LLM Benchmark	—	41.4%
NYT Connections (extended)	—	12.9%
Chess Puzzles	0%	—
LMArena Hard Prompts	—	1436
Epoch Capabilities Index	—	141.35

Math Mistral Medium 3.5 leads

Gemma 3 1B: 10.2 (#316), Mistral Medium 3.5: 39.1 (#113)

Math benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
OTIS Mock AIME 2024-2025	1.1%	—
LMArena Math	—	1431

Knowledge Mistral Medium 3.5 leads

Gemma 3 1B: 7.0 (#314), Mistral Medium 3.5: 40.0 (#126)

Knowledge benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
GPQA Diamond	19.9%	—
LMArena Expert	—	1432

Multimodal Not comparable

Gemma 3 1B: —, Mistral Medium 3.5: 38.3 (#65)

Multimodal benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
LMArena Vision	—	1223

Multilingual Not comparable

Gemma 3 1B: —, Mistral Medium 3.5: 51.9 (#100)

Multilingual benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
LMArena Non-English	—	1404
LMArena Chinese	—	1442
LMArena French	—	1448
LMArena German	—	1451
LMArena Korean	—	1385
LMArena Russian	—	1395
LMArena Spanish	—	1409

Instruction Following Not comparable

Gemma 3 1B: —, Mistral Medium 3.5: 74.6 (#90)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
LMArena Instruction Following	—	1415

Long Context Not comparable

Gemma 3 1B: —, Mistral Medium 3.5: 43.2 (#103)

Long Context benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
LMArena Longer Query	—	1415

Writing & Preference Not comparable

Gemma 3 1B: —, Mistral Medium 3.5: 58.5 (#117)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	Mistral Medium 3.5
LMArena Text	—	1421
LMArena Creative Writing	—	1374
EQ-Bench 4	—	993
LMArena Multi-Turn	—	1423

Frequently asked questions

Is Gemma 3 1B better than Mistral Medium 3.5?