Noometry

Model comparison

Gemma 3 4B vs GLM-4.6

GLM-4.6 is the stronger model overall, scoring 41.4 to 28.1 on the Noometry Index. Gemma 3 4B costs 20× less per token, which makes it the better buy when GLM-4.6's lead doesn't matter for your workload.

Last verified . 16 shared benchmarks.

Gemma 3 4B Google

28.1

Rank #326 Confirmed

GLM-4.6 Z.ai (Zhipu)

41.4

Rank #135 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Gemma 3 4B scores higher in 0 categories and GLM-4.6 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.6 leads 40.2 to 11.8.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 19.6% for Gemma 3 4B and 72.4% for GLM-4.6.
  • Gemma 3 4B is cheaper at $0.04 / $0.08 per million input/output tokens, against $0.60 / $2.20 for GLM-4.6.
  • GLM-4.6 accepts more context: 205K tokens versus 131K.

Side by side

Gemma 3 4BGLM-4.6
ProviderGoogleZ.ai (Zhipu)
Noometry Index28.141.4
Released2025-03-122025-09-30
WeightsOpenOpen
Context window131K205K
Max output4K131K
Input $ / M tokens$0.04$0.60
Output $ / M tokens$0.08$2.20
Results tracked2229

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6 leads

Gemma 3 4B: 35.9 (#215), GLM-4.6: 40.1 (#148)

BenchmarkGemma 3 4BGLM-4.6
LMArena Coding12301449
SWE-bench Verified (bash only)—55.4%
LMArena WebDev—1340
SciCode—38.4%
ALE-Bench—340.82

Agentic & Tool Use GLM-4.6 leads

Gemma 3 4B: 20.9 (#142), GLM-4.6: 32.3 (#66)

BenchmarkGemma 3 4BGLM-4.6
Berkeley Function Calling Leaderboard19.6%72.4%
Terminal-Bench—24.5%

Reasoning GLM-4.6 leads

Gemma 3 4B: 13.2 (#335), GLM-4.6: 23.7 (#172)

BenchmarkGemma 3 4BGLM-4.6
Kagi LLM Benchmark25.2%47.4%
LMArena Hard Prompts12531440
CritPt—1.1%
Chess Puzzles0%—
DTBench50.9%—
LMCA2.8%—
Epoch Capabilities Index116.02—

Math GLM-4.6 leads

Gemma 3 4B: 16.8 (#292), GLM-4.6: 39.1 (#111)

BenchmarkGemma 3 4BGLM-4.6
LMArena Math12391432
OTIS Mock AIME 2024-20257.5%—
FrontierMath (Feb 2025 set)—3.8%
FrontierMath Tier 4 (v1)—2.1%

Knowledge GLM-4.6 leads

Gemma 3 4B: 11.8 (#299), GLM-4.6: 40.2 (#124)

BenchmarkGemma 3 4BGLM-4.6
Vectara Hallucination Rate6.4%9.5%
LMArena Expert12231431
GPQA Diamond23.2%—

Multilingual GLM-4.6 leads

Gemma 3 4B: 42.5 (#194), GLM-4.6: 53.5 (#66)

BenchmarkGemma 3 4BGLM-4.6
LMArena Non-English12731426
LMArena German12811447
LMArena Russian12941419
LMArena Chinese—1499
LMArena French—1459
LMArena Japanese—1393
LMArena Korean—1400
LMArena Spanish—1436

Instruction Following GLM-4.6 leads

Gemma 3 4B: 65.2 (#225), GLM-4.6: 74.3 (#98)

BenchmarkGemma 3 4BGLM-4.6
LMArena Instruction Following12391410

Long Context GLM-4.6 leads

Gemma 3 4B: 38.7 (#194), GLM-4.6: 43.4 (#94)

BenchmarkGemma 3 4BGLM-4.6
LMArena Longer Query12731422

Writing & Preference GLM-4.6 leads

Gemma 3 4B: 42.0 (#239), GLM-4.6: 61.1 (#90)

BenchmarkGemma 3 4BGLM-4.6
LMArena Text12911440
LMArena Creative Writing12711411
EQ-Bench Creative Writing10681411
LMArena Multi-Turn12551427

Frequently asked questions

Is Gemma 3 4B better than GLM-4.6?

GLM-4.6 is the stronger model overall, scoring 41.4 to 28.1 on the Noometry Index. Gemma 3 4B costs 20× less per token, which makes it the better buy when GLM-4.6's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 4B or GLM-4.6?

Gemma 3 4B is cheaper. It lists at $0.04 per million input tokens and $0.08 per million output tokens; GLM-4.6 lists at $0.60 and $2.20.

Is Gemma 3 4B or GLM-4.6 better for coding?

GLM-4.6 scores higher on coding benchmarks: 40.1 versus 35.9 in the Noometry coding category.

Which has the bigger context window?

GLM-4.6 does, with 205K tokens against 131K.

How many benchmarks do Gemma 3 4B and GLM-4.6 share?

16 benchmarks have published results for both models. Gemma 3 4B has 22 scored results on Noometry and GLM-4.6 has 29.

Related comparisons

Go deeper