Noometry

Model comparison

Gemma 3 1B vs GLM-4.6

GLM-4.6 is the stronger model overall, scoring 40.9 to 20.7 on the Noometry Index.

Last verified . 1 shared benchmarks.

Gemma 3 1B Google

20.7

Rank #348 Reported

GLM-4.6 Z.ai (Zhipu)

40.9

Rank #132 Confirmed

Summary

  • They share 1 benchmark with published results for both. Gemma 3 1B scores higher in 0 categories and GLM-4.6 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.6 leads 39.6 to 7.1.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 7.2% for Gemma 3 1B and 72.4% for GLM-4.6.

Side by side

Gemma 3 1BGLM-4.6
ProviderGoogleZ.ai (Zhipu)
Noometry Index20.740.9
Released2025-03-122025-09-30
WeightsOpenOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.60
Output $ / M tokens—$2.20
Results tracked429

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, GLM-4.6: 39.9 (#137)

BenchmarkGemma 3 1BGLM-4.6
SWE-bench Verified (bash only)—55.4%
LMArena WebDev—1339
SciCode—38.4%
LMArena Coding—1449
ALE-Bench—340.82

Agentic & Tool Use GLM-4.6 leads

Gemma 3 1B: 13.5 (#144), GLM-4.6: 32.1 (#60)

BenchmarkGemma 3 1BGLM-4.6
Berkeley Function Calling Leaderboard7.2%72.4%
Terminal-Bench—24.5%

Reasoning GLM-4.6 leads

Gemma 3 1B: 18.5 (#260), GLM-4.6: 23.1 (#168)

BenchmarkGemma 3 1BGLM-4.6
Kagi LLM Benchmark—47.4%
CritPt—1.1%
Chess Puzzles0%—
LMArena Hard Prompts—1440

Math GLM-4.6 leads

Gemma 3 1B: 9.6 (#310), GLM-4.6: 36.4 (#115)

BenchmarkGemma 3 1BGLM-4.6
OTIS Mock AIME 2024-20251.1%—
LMArena Math—1431
FrontierMath (Feb 2025 set)—3.8%
FrontierMath Tier 4 (v1)—2.1%

Knowledge GLM-4.6 leads

Gemma 3 1B: 7.1 (#309), GLM-4.6: 39.6 (#118)

BenchmarkGemma 3 1BGLM-4.6
GPQA Diamond19.9%—
Vectara Hallucination Rate—9.5%
LMArena Expert—1432

Multilingual Not comparable

Gemma 3 1B: —, GLM-4.6: 53.6 (#62)

BenchmarkGemma 3 1BGLM-4.6
LMArena Non-English—1426
LMArena Chinese—1500
LMArena French—1459
LMArena German—1447
LMArena Japanese—1394
LMArena Korean—1401
LMArena Russian—1418
LMArena Spanish—1436

Instruction Following Not comparable

Gemma 3 1B: —, GLM-4.6: 74.5 (#93)

BenchmarkGemma 3 1BGLM-4.6
LMArena Instruction Following—1410

Long Context Not comparable

Gemma 3 1B: —, GLM-4.6: 43.4 (#91)

BenchmarkGemma 3 1BGLM-4.6
LMArena Longer Query—1423

Writing & Preference Not comparable

Gemma 3 1B: —, GLM-4.6: 61.3 (#86)

BenchmarkGemma 3 1BGLM-4.6
LMArena Text—1440
LMArena Creative Writing—1411
EQ-Bench Creative Writing—1411
LMArena Multi-Turn—1427

Frequently asked questions

Is Gemma 3 1B better than GLM-4.6?

GLM-4.6 is the stronger model overall, scoring 40.9 to 20.7 on the Noometry Index.

How many benchmarks do Gemma 3 1B and GLM-4.6 share?

1 benchmark has published results for both models. Gemma 3 1B has 4 scored results on Noometry and GLM-4.6 has 29.

Related comparisons

Go deeper