Noometry

Model comparison

Gemma 3 1B vs GLM-4.7

GLM-4.7 is the stronger model overall, scoring 42.0 to 21.1 on the Noometry Index.

Last verified . 3 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

GLM-4.7 Z.ai (Zhipu)

42.0

Rank #124 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and GLM-4.7 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.7 leads 47.0 to 7.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemma 3 1B and 83.3% for GLM-4.7.

Side by side

Gemma 3 1BGLM-4.7
ProviderGoogleZ.ai (Zhipu)
Noometry Index21.142.0
Released2025-03-122025-12-22
WeightsOpenOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.60
Output $ / M tokens—$2.20
Results tracked436

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, GLM-4.7: 44.0 (#79)

BenchmarkGemma 3 1BGLM-4.7
LMArena WebDev—1435
SciCode—45.1%
LMArena Coding—1454
ALE-Bench—399.48

Agentic & Tool Use GLM-4.7 leads

Gemma 3 1B: 13.7 (#152), GLM-4.7: 26.5 (#103)

BenchmarkGemma 3 1BGLM-4.7
Terminal-Bench—33.4%
Berkeley Function Calling Leaderboard7.2%—
Vending-Bench 2—2,377

Reasoning GLM-4.7 leads

Gemma 3 1B: 19.2 (#264), GLM-4.7: 24.3 (#164)

BenchmarkGemma 3 1BGLM-4.7
Chess Puzzles0%6%
SimpleBench—47.7%
CritPt—1.7%
LMArena Hard Prompts—1443
Epoch Capabilities Index—143.51

Math GLM-4.7 leads

Gemma 3 1B: 10.2 (#316), GLM-4.7: 38.6 (#135)

BenchmarkGemma 3 1BGLM-4.7
OTIS Mock AIME 2024-20251.1%83.3%
ProofBench—6%
LMArena Math—1423
FrontierMath (Feb 2025 set)—2.4%
FrontierMath Tier 4 (v1)—0%

Knowledge GLM-4.7 leads

Gemma 3 1B: 7.0 (#314), GLM-4.7: 47.0 (#80)

BenchmarkGemma 3 1BGLM-4.7
GPQA Diamond19.9%83.3%
SimpleQA Verified—32.2%
Vectara Hallucination Rate—11.7%
LMArena Expert—1424

Multilingual Not comparable

Gemma 3 1B: —, GLM-4.7: 52.8 (#79)

BenchmarkGemma 3 1BGLM-4.7
LMArena Non-English—1417
LMArena Chinese—1495
LMArena French—1432
LMArena German—1424
LMArena Japanese—1439
LMArena Korean—1399
LMArena Russian—1423
LMArena Spanish—1434

Instruction Following Not comparable

Gemma 3 1B: —, GLM-4.7: 74.4 (#95)

BenchmarkGemma 3 1BGLM-4.7
LMArena Instruction Following—1411

Long Context Not comparable

Gemma 3 1B: —, GLM-4.7: 42.8 (#116)

BenchmarkGemma 3 1BGLM-4.7
CL-bench—15.9%
CL-bench Life—10.9%
LMArena Longer Query—1432

Writing & Preference Not comparable

Gemma 3 1B: —, GLM-4.7: 60.9 (#93)

BenchmarkGemma 3 1BGLM-4.7
LMArena Text—1435
LMArena Creative Writing—1401
EQ-Bench Creative Writing—1413
LMArena Multi-Turn—1446

Frequently asked questions

Is Gemma 3 1B better than GLM-4.7?

GLM-4.7 is the stronger model overall, scoring 42.0 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and GLM-4.7 share?

3 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and GLM-4.7 has 36.

Related comparisons

Go deeper