Model comparison

Gemma 3 1B vs Gemma 3 4B

Gemma 3 4B is the stronger model overall, scoring 28.1 to 21.1 on the Noometry Index.

Last verified October 10, 2026. 4 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

Gemma 3 4B

Google

28.1

Rank #326 Confirmed

Summary

They share 4 benchmarks with published results for both. Gemma 3 1B scores higher in 1 category and Gemma 3 4B in 3 categories; 4 gaps are clear of the uncertainty.
The widest gap is in agentic & tool use, where Gemma 3 4B leads 20.9 to 13.7.
The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 7.2% for Gemma 3 1B and 19.6% for Gemma 3 4B.

Side by side

Gemma 3 1B and Gemma 3 4B specifications
	Gemma 3 1B	Gemma 3 4B
Provider	Google	Google
Noometry Index	21.1	28.1
Released	2025-03-12	2025-03-12
Weights	Open	Open
Context window	—	131K
Max output	—	4K
Input $ / M tokens	—	$0.04
Output $ / M tokens	—	$0.08
Results tracked	4	22

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Gemma 3 4B: 35.9 (#215)

Coding benchmarks
Benchmark	Gemma 3 1B	Gemma 3 4B
LMArena Coding	—	1230

Agentic & Tool Use Gemma 3 4B leads

Gemma 3 1B: 13.7 (#152), Gemma 3 4B: 20.9 (#142)

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	Gemma 3 4B
Berkeley Function Calling Leaderboard	7.2%	19.6%

Reasoning Gemma 3 1B leads

Gemma 3 1B: 19.2 (#264), Gemma 3 4B: 13.2 (#335)

Reasoning benchmarks
Benchmark	Gemma 3 1B	Gemma 3 4B
Chess Puzzles	0%	0%
Kagi LLM Benchmark	—	25.2%
LMArena Hard Prompts	—	1253
DTBench	—	50.9%
LMCA	—	2.8%
Epoch Capabilities Index	—	116.02

Math Gemma 3 4B leads

Gemma 3 1B: 10.2 (#316), Gemma 3 4B: 16.8 (#292)

Math benchmarks
Benchmark	Gemma 3 1B	Gemma 3 4B
OTIS Mock AIME 2024-2025	1.1%	7.5%
LMArena Math	—	1239

Knowledge Gemma 3 4B leads

Gemma 3 1B: 7.0 (#314), Gemma 3 4B: 11.8 (#299)

Knowledge benchmarks
Benchmark	Gemma 3 1B	Gemma 3 4B
GPQA Diamond	19.9%	23.2%
Vectara Hallucination Rate	—	6.4%
LMArena Expert	—	1223

Multilingual Not comparable

Gemma 3 1B: —, Gemma 3 4B: 42.5 (#194)

Multilingual benchmarks
Benchmark	Gemma 3 1B	Gemma 3 4B
LMArena Non-English	—	1273
LMArena German	—	1281
LMArena Russian	—	1294

Instruction Following Not comparable

Gemma 3 1B: —, Gemma 3 4B: 65.2 (#225)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	Gemma 3 4B
LMArena Instruction Following	—	1239

Long Context Not comparable

Gemma 3 1B: —, Gemma 3 4B: 38.7 (#194)

Long Context benchmarks
Benchmark	Gemma 3 1B	Gemma 3 4B
LMArena Longer Query	—	1273

Writing & Preference Not comparable

Gemma 3 1B: —, Gemma 3 4B: 42.0 (#239)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	Gemma 3 4B
LMArena Text	—	1291
LMArena Creative Writing	—	1271
EQ-Bench Creative Writing	—	1068
LMArena Multi-Turn	—	1255

Frequently asked questions

Is Gemma 3 1B better than Gemma 3 4B?