Model comparison

Gemma 3 1B vs Llama 4 Maverick

Llama 4 Maverick is the stronger model overall, scoring 30.9 to 21.1 on the Noometry Index.

Last verified October 10, 2026. 3 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

Llama 4 Maverick

Summary

They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 1 category and Llama 4 Maverick in 3 categories; 4 gaps are clear of the uncertainty.
The widest gap is in knowledge, where Llama 4 Maverick leads 33.4 to 7.0.
The biggest single-benchmark swing is GPQA Diamond: 19.9% for Gemma 3 1B and 67% for Llama 4 Maverick.

Side by side

Gemma 3 1B and Llama 4 Maverick specifications
	Gemma 3 1B	Llama 4 Maverick
Provider	Google	Meta
Noometry Index	21.1	30.9
Released	2025-03-12	2025-04-05
Weights	Open	Open
Context window	—	128K
Max output	—	4K
Input $ / M tokens	—	$0.19
Output $ / M tokens	—	$0.65
Results tracked	4	54

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Llama 4 Maverick: 26.6 (#324)

Coding benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
SWE-bench Verified (bash only)	—	21%
Aider Polyglot	—	15.6%
SciCode	—	33.1%
WeirdML	—	24.5%
BigCodeBench Instruct	—	49.7%
LMArena Coding	—	1302
BigCodeBench Complete	—	61.4%
ALE-Bench	—	172.97

Agentic & Tool Use Llama 4 Maverick leads

Gemma 3 1B: 13.7 (#152), Llama 4 Maverick: 28.2 (#91)

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
Berkeley Function Calling Leaderboard	7.2%	37.3%

Reasoning Gemma 3 1B leads

Gemma 3 1B: 19.2 (#264), Llama 4 Maverick: 10.1 (#342)

Reasoning benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
ARC-AGI-2	—	0%
SimpleBench	—	27.7%
Kagi LLM Benchmark	—	55.9%
NYT Connections (extended)	—	8%
ARC-AGI-1	—	4.4%
CritPt	—	0%
Chess Puzzles	0%	—
EnigmaEval	—	0.6%
LMArena Hard Prompts	—	1281
DTBench	—	61.9%
LMCA	—	15.9%
Epoch Capabilities Index	—	132.2
ForecastBench	—	57.5

Math Llama 4 Maverick leads

Gemma 3 1B: 10.2 (#316), Llama 4 Maverick: 26.0 (#262)

Math benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
OTIS Mock AIME 2024-2025	1.1%	20.6%
Omni-MATH	—	42.2%
LMArena Math	—	1299
MATH Level 5	—	73%
FrontierMath (Feb 2025 set)	—	0.7%

Knowledge Llama 4 Maverick leads

Gemma 3 1B: 7.0 (#314), Llama 4 Maverick: 33.4 (#204)

Knowledge benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
GPQA Diamond	19.9%	67%
Humanity's Last Exam	—	5.7%
MMLU-Pro	—	81%
Confabulations	—	22.6%
Vectara Hallucination Rate	—	8.2%
GPQA (HELM)	—	65%
LMArena Expert	—	1259

Multimodal Not comparable

Gemma 3 1B: —, Llama 4 Maverick: 31.6 (#105)

Multimodal benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
LMArena Vision	—	1142
GeoBench	—	52%
SpatialViz-Bench	—	31.8%

Multilingual Not comparable

Gemma 3 1B: —, Llama 4 Maverick: 42.2 (#195)

Multilingual benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
LMArena Non-English	—	1269
LMArena Chinese	—	1277
LMArena French	—	1259
LMArena German	—	1291
LMArena Japanese	—	1207
LMArena Korean	—	1203
LMArena Russian	—	1286
LMArena Spanish	—	1293

Instruction Following Not comparable

Gemma 3 1B: —, Llama 4 Maverick: 71.7 (#146)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
IFEval	—	90.8%
LMArena Instruction Following	—	1267

Long Context Not comparable

Gemma 3 1B: —, Llama 4 Maverick: 31.4 (#279)

Long Context benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
Fiction.LiveBench	—	46.2%
LMArena Longer Query	—	1280

Writing & Preference Not comparable

Gemma 3 1B: —, Llama 4 Maverick: 38.8 (#252)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	Llama 4 Maverick
LMArena Text	—	1287
LMArena Creative Writing	—	1267
Short-Story Creative Writing	—	62%
EQ-Bench Creative Writing	—	860
WildBench	—	80%
LMArena Multi-Turn	—	1289

Frequently asked questions

Is Gemma 3 1B better than Llama 4 Maverick?