Model comparison

Gemma 3 1B vs Llama 4 Scout

Llama 4 Scout is the stronger model overall, scoring 27.7 to 21.1 on the Noometry Index.

Last verified October 11, 2026. 3 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

Llama 4 Scout

Summary

They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 1 category and Llama 4 Scout in 3 categories; 4 gaps are clear of the uncertainty.
The widest gap is in knowledge, where Llama 4 Scout leads 31.9 to 7.0.
The biggest single-benchmark swing is GPQA Diamond: 19.9% for Gemma 3 1B and 51.8% for Llama 4 Scout.

Side by side

Gemma 3 1B and Llama 4 Scout specifications
	Gemma 3 1B	Llama 4 Scout
Provider	Google	Meta
Noometry Index	21.1	27.7
Released	2025-03-12	2025-04-05
Weights	Open	Open
Context window	—	128K
Max output	—	4K
Input $ / M tokens	—	$0.10
Output $ / M tokens	—	$0.30
Results tracked	4	43

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Llama 4 Scout: 20.2 (#339)

Coding benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
SWE-bench Verified (bash only)	—	9.1%
SciCode	—	17%
LMArena Coding	—	1286
BigCodeBench Complete	—	43.1%

Agentic & Tool Use Llama 4 Scout leads

Gemma 3 1B: 13.7 (#152), Llama 4 Scout: 24.6 (#119)

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
Berkeley Function Calling Leaderboard	7.2%	28.1%

Reasoning Gemma 3 1B leads

Gemma 3 1B: 19.2 (#264), Llama 4 Scout: 9.1 (#345)

Reasoning benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
ARC-AGI-2	—	0%
Kagi LLM Benchmark	—	36.9%
ARC-AGI-1	—	0.5%
CritPt	—	0%
Chess Puzzles	0%	—
LMArena Hard Prompts	—	1266
DTBench	—	57.9%
LMCA	—	12%
Epoch Capabilities Index	—	129.64
ForecastBench	—	57.5

Math Llama 4 Scout leads

Gemma 3 1B: 10.2 (#316), Llama 4 Scout: 19.6 (#286)

Math benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
OTIS Mock AIME 2024-2025	1.1%	7.8%
Omni-MATH	—	37.3%
LMArena Math	—	1287
MATH Level 5	—	62.3%
FrontierMath (Feb 2025 set)	—	0%

Knowledge Llama 4 Scout leads

Gemma 3 1B: 7.0 (#314), Llama 4 Scout: 31.9 (#217)

Knowledge benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
GPQA Diamond	19.9%	51.8%
MMLU-Pro	—	74.2%
Vectara Hallucination Rate	—	7.7%
GPQA (HELM)	—	50.7%
LMArena Expert	—	1235

Multimodal Not comparable

Gemma 3 1B: —, Llama 4 Scout: 32.2 (#102)

Multimodal benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
LMArena Vision	—	1118
SpatialViz-Bench	—	34.2%

Multilingual Not comparable

Gemma 3 1B: —, Llama 4 Scout: 41.0 (#212)

Multilingual benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
LMArena Non-English	—	1252
LMArena Chinese	—	1255
LMArena French	—	1282
LMArena German	—	1272
LMArena Japanese	—	1206
LMArena Korean	—	1207
LMArena Russian	—	1263
LMArena Spanish	—	1278

Instruction Following Not comparable

Gemma 3 1B: —, Llama 4 Scout: 65.8 (#217)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
IFEval	—	81.8%
LMArena Instruction Following	—	1248

Long Context Not comparable

Gemma 3 1B: —, Llama 4 Scout: 27.5 (#294)

Long Context benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
Fiction.LiveBench	—	36%
LMArena Longer Query	—	1265

Writing & Preference Not comparable

Gemma 3 1B: —, Llama 4 Scout: 37.0 (#261)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	Llama 4 Scout
LMArena Text	—	1279
LMArena Creative Writing	—	1249
EQ-Bench Creative Writing	—	783
WildBench	—	78%
LMArena Multi-Turn	—	1280

Frequently asked questions

Is Gemma 3 1B better than Llama 4 Scout?