Model comparison

Gemma 3 1B vs GPT-5 Nano

GPT-5 Nano is the stronger model overall, scoring 33.5 to 21.1 on the Noometry Index.

Last verified October 10, 2026. 4 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

GPT-5 Nano OpenAI

33.5

Rank #241 Confirmed

Summary

They share 4 benchmarks with published results for both. Gemma 3 1B scores higher in 1 category and GPT-5 Nano in 3 categories; 4 gaps are clear of the uncertainty.
The widest gap is in knowledge, where GPT-5 Nano leads 35.9 to 7.0.
The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemma 3 1B and 81.1% for GPT-5 Nano.
Gemma 3 1B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 1B and GPT-5 Nano specifications
	Gemma 3 1B	GPT-5 Nano
Provider	Google	OpenAI
Noometry Index	21.1	33.5
Released	2025-03-12	2025-08-07
Weights	Open	Proprietary
Context window	—	400K
Max output	—	128K
Input $ / M tokens	—	$0.05
Output $ / M tokens	—	$0.40
Results tracked	4	49

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, GPT-5 Nano: 33.6 (#254)

Coding benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
SWE-bench Verified (bash only)	—	34.8%
WeirdML	—	38.1%
LMArena Coding	—	1351
ALE-Bench	—	718.67

Agentic & Tool Use GPT-5 Nano leads

Gemma 3 1B: 13.7 (#152), GPT-5 Nano: 25.8 (#106)

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
Berkeley Function Calling Leaderboard	7.2%	51.5%
Terminal-Bench	—	21.8%

Reasoning Gemma 3 1B leads

Gemma 3 1B: 19.2 (#264), GPT-5 Nano: 16.3 (#306)

Reasoning benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
Chess Puzzles	0%	27%
ARC-AGI-2	—	2.6%
Kagi LLM Benchmark	—	62.2%
ARC-AGI-1	—	20.7%
LMArena Hard Prompts	—	1328
Mystery Game Puzzles	—	9%
DTBench	—	62.7%
LMCA	—	7.9%
Epoch Capabilities Index	—	139.38
ForecastBench	—	59.1

Math GPT-5 Nano leads

Gemma 3 1B: 10.2 (#316), GPT-5 Nano: 29.4 (#241)

Math benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
OTIS Mock AIME 2024-2025	1.1%	81.1%
FrontierMath (Tiers 1-3)	—	20%
FrontierMath Tier 4	—	2.4%
ProofBench	—	12%
Omni-MATH	—	54.6%
LMArena Math	—	1317
MATH Level 5	—	95.2%
FrontierMath (Feb 2025 set)	—	8.3%
FrontierMath Tier 4 (v1)	—	2.1%

Knowledge GPT-5 Nano leads

Gemma 3 1B: 7.0 (#314), GPT-5 Nano: 35.9 (#178)

Knowledge benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
GPQA Diamond	19.9%	69.4%
SimpleQA Verified	—	11.7%
MMLU-Pro	—	77.8%
Vectara Hallucination Rate	—	10.5%
GPQA (HELM)	—	67.9%
LMArena Expert	—	1321

Multimodal Not comparable

Gemma 3 1B: —, GPT-5 Nano: 31.3 (#108)

Multimodal benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
LMArena Vision	—	1159
VPCT	—	37.2%

Multilingual Not comparable

Gemma 3 1B: —, GPT-5 Nano: 45.3 (#172)

Multilingual benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
LMArena Non-English	—	1313
LMArena Chinese	—	1356
LMArena German	—	1327
LMArena Japanese	—	1226
LMArena Korean	—	1269
LMArena Russian	—	1296
LMArena Spanish	—	1360

Instruction Following Not comparable

Gemma 3 1B: —, GPT-5 Nano: 75.0 (#79)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
IFEval	—	93.2%
LMArena Instruction Following	—	1306

Long Context Not comparable

Gemma 3 1B: —, GPT-5 Nano: 31.3 (#281)

Long Context benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
Fiction.LiveBench	—	44.4%
LMArena Longer Query	—	1312

Writing & Preference Not comparable

Gemma 3 1B: —, GPT-5 Nano: 39.1 (#249)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	GPT-5 Nano
LMArena Text	—	1320
LMArena Creative Writing	—	1249
EQ-Bench Creative Writing	—	705
WildBench	—	80.6%
LMArena Multi-Turn	—	1311

Frequently asked questions

Is Gemma 3 1B better than GPT-5 Nano?