Model comparison

Gemma 3 1B vs GLM-5

GLM-5 is the stronger model overall, scoring 46.1 to 21.1 on the Noometry Index.

Last verified October 10, 2026. 3 shared benchmarks.

Gemma 3 1B

Google

21.1

Rank #353 Reported

GLM-5 Z.ai (Zhipu)

46.1

Rank #66 Confirmed

Summary

They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and GLM-5 in 4 categories; 4 gaps are clear of the uncertainty.
The widest gap is in knowledge, where GLM-5 leads 52.3 to 7.0.
The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemma 3 1B and 80% for GLM-5.

Side by side

Gemma 3 1B and GLM-5 specifications
	Gemma 3 1B	GLM-5
Provider	Google	Z.ai (Zhipu)
Noometry Index	21.1	46.1
Released	2025-03-12	2026-02-11
Weights	Open	Open
Context window	—	205K
Max output	—	131K
Input $ / M tokens	—	$1
Output $ / M tokens	—	$3.20
Results tracked	4	45

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, GLM-5: 49.0 (#52)

Coding benchmarks
Benchmark	Gemma 3 1B	GLM-5
SWE-bench Verified	—	72.1%
SWE-bench Verified (bash only)	—	72.8%
LMArena WebDev	—	1434
SWE-bench Multilingual	—	69.7%
WeirdML	—	48.2%
LMArena Coding	—	1461
ALE-Bench	—	765.62

Agentic & Tool Use GLM-5 leads

Gemma 3 1B: 13.7 (#152), GLM-5: 31.1 (#71)

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 1B	GLM-5
Terminal-Bench	—	52.4%
Berkeley Function Calling Leaderboard	7.2%	—
τ²-bench Airline	—	82.5%
τ²-bench Banking	—	9.8%
τ²-bench Retail	—	73.7%
τ²-bench Telecom	—	86.8%
Vending-Bench 2	—	4,432

Reasoning GLM-5 leads

Gemma 3 1B: 19.2 (#264), GLM-5: 27.6 (#116)

Reasoning benchmarks
Benchmark	Gemma 3 1B	GLM-5
Chess Puzzles	0%	10%
ARC-AGI-2	—	4.9%
SimpleBench	—	53.2%
Kagi LLM Benchmark	—	75%
NYT Connections (extended)	—	74.8%
ARC-AGI-1	—	44.7%
LMArena Hard Prompts	—	1452
Epoch Capabilities Index	—	145.83
ForecastBench	—	61

Math GLM-5 leads

Gemma 3 1B: 10.2 (#316), GLM-5: 46.4 (#71)

Math benchmarks
Benchmark	Gemma 3 1B	GLM-5
OTIS Mock AIME 2024-2025	1.1%	80%
MathArena Final-Answer Competitions	—	65.7%
LMArena Math	—	1440
FrontierMath (Feb 2025 set)	—	16.4%
FrontierMath Tier 4 (v1)	—	2.1%

Knowledge GLM-5 leads

Gemma 3 1B: 7.0 (#314), GLM-5: 52.3 (#64)

Knowledge benchmarks
Benchmark	Gemma 3 1B	GLM-5
GPQA Diamond	19.9%	87.8%
Vectara Hallucination Rate	—	10.1%
LMArena Expert	—	1454

Multilingual Not comparable

Gemma 3 1B: —, GLM-5: 53.7 (#58)

Multilingual benchmarks
Benchmark	Gemma 3 1B	GLM-5
LMArena Non-English	—	1430
LMArena Chinese	—	1511
LMArena French	—	1455
LMArena German	—	1445
LMArena Japanese	—	1416
LMArena Korean	—	1423
LMArena Russian	—	1436
LMArena Spanish	—	1454

Instruction Following Not comparable

Gemma 3 1B: —, GLM-5: 75.2 (#67)

Instruction Following benchmarks
Benchmark	Gemma 3 1B	GLM-5
LMArena Instruction Following	—	1428

Long Context Not comparable

Gemma 3 1B: —, GLM-5: 44.7 (#60)

Long Context benchmarks
Benchmark	Gemma 3 1B	GLM-5
CL-bench	—	18.7%
LMArena Longer Query	—	1446

Writing & Preference Not comparable

Gemma 3 1B: —, GLM-5: 66.0 (#38)

Writing & Preference benchmarks
Benchmark	Gemma 3 1B	GLM-5
LMArena Text	—	1446
LMArena Creative Writing	—	1439
EQ-Bench Creative Writing	—	1601
LMArena Multi-Turn	—	1456

Frequently asked questions

Is Gemma 3 1B better than GLM-5?