Model comparison

Gemma 3 1B vs GPT-5.2

GPT-5.2 is the stronger model overall, scoring 54.1 to 21.1 on the Noometry Index.

Last verified October 11, 2026. 4 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

GPT-5.2 OpenAI

54.1

Rank #34 Confirmed

Summary

They share 4 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and GPT-5.2 in 4 categories; 4 gaps are clear of the uncertainty.
The widest gap is in knowledge, where GPT-5.2 leads 59.3 to 7.0.
The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemma 3 1B and 96.1% for GPT-5.2.
Gemma 3 1B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 1B and GPT-5.2 specifications
	Gemma 3 1B	GPT-5.2
Provider	Google	OpenAI
Noometry Index	21.1	54.1
Released	2025-03-12	2025-12-11
Weights	Open	Proprietary
Context window	—	400K
Max output	—	128K
Input $ / M tokens	—	$1.75
Output $ / M tokens	—	$14
Results tracked	4	67

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, GPT-5.2: 51.6 (#37)

Coding benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
SWE-bench Verified	—	73.8%
SWE-bench Verified (bash only)	—	72.8%
LMArena WebDev	—	1416
SWE-bench Multilingual	—	66.7%
GSO	—	27.4%
WeirdML	—	72.2%
LMArena Coding	—	1447
ALE-Bench	—	1,294
AlgoTune	—	2.05

Agentic & Tool Use GPT-5.2 leads

Gemma 3 1B: 13.7 (#152), GPT-5.2: 40.2 (#24)

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
Berkeley Function Calling Leaderboard	7.2%	55.9%
Terminal-Bench	—	64.9%
GDPval	—	49.7%
Remote Labor Index	—	2.5%
τ²-bench Airline	—	83%
τ²-bench Banking	—	32.2%
τ²-bench Retail	—	81.6%
τ²-bench Telecom	—	89.7%
DeepResearch Bench	—	41.1%
LMArena Search	—	1207
METR Time Horizons	—	75.3%
Vending-Bench 2	—	3,591

Reasoning GPT-5.2 leads

Gemma 3 1B: 19.2 (#264), GPT-5.2: 50.2 (#35)

Reasoning benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
Chess Puzzles	0%	49%
ARC-AGI-2	—	52.9%
SimpleBench	—	45.8%
Kagi LLM Benchmark	—	73.3%
NYT Connections (extended)	—	83.6%
ARC-AGI-1	—	86.2%
EnigmaEval	—	10.4%
EBR-Bench	—	23%
LMArena Hard Prompts	—	1445
Mystery Game Puzzles	—	23%
DTBench	—	90.9%
LMCA	—	43.9%
Epoch Capabilities Index	—	153.45
ForecastBench	—	60.1

Math GPT-5.2 leads

Gemma 3 1B: 10.2 (#316), GPT-5.2: 60.0 (#38)

Math benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
OTIS Mock AIME 2024-2025	1.1%	96.1%
FrontierMath (Tiers 1-3)	—	67.4%
FrontierMath Tier 4	—	31.7%
MathArena Final-Answer Competitions	—	72%
ProofBench	—	15%
LMArena Math	—	1440
FrontierMath (Feb 2025 set)	—	40.7%
FrontierMath Tier 4 (v1)	—	18.8%

Knowledge GPT-5.2 leads

Gemma 3 1B: 7.0 (#314), GPT-5.2: 59.3 (#32)

Knowledge benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
GPQA Diamond	19.9%	91.4%
Humanity's Last Exam	—	27.8%
SimpleQA Verified	—	37.1%
Vectara Hallucination Rate	—	8.4%
LMArena Expert	—	1445

Multimodal Not comparable

Gemma 3 1B: —, GPT-5.2: 51.3 (#7)

Multimodal benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
LMArena Vision	—	1268
VPCT	—	84%
Furniture Assembly	—	38.3%
LMArena Document	—	1405

Multilingual Not comparable

Gemma 3 1B: —, GPT-5.2: 53.4 (#67)

Multilingual benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
LMArena Non-English	—	1425
LMArena Chinese	—	1460
LMArena French	—	1455
LMArena German	—	1448
LMArena Japanese	—	1420
LMArena Korean	—	1392
LMArena Russian	—	1440
LMArena Spanish	—	1433

Instruction Following Not comparable

Gemma 3 1B: —, GPT-5.2: 74.7 (#89)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
LMArena Instruction Following	—	1417

Long Context Not comparable

Gemma 3 1B: —, GPT-5.2: 44.0 (#78)

Long Context benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
CL-bench	—	18.2%
LMArena Longer Query	—	1428

Writing & Preference Not comparable

Gemma 3 1B: —, GPT-5.2: 66.8 (#32)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	GPT-5.2
LMArena Text	—	1439
LMArena Creative Writing	—	1401
EQ-Bench Creative Writing	—	1703
LMArena Multi-Turn	—	1458

Frequently asked questions

Is Gemma 3 1B better than GPT-5.2?