Model comparison

Gemma 3 4B vs GLM-4.5V

GLM-4.5V is the stronger model overall, scoring 39.8 to 28.1 on the Noometry Index. Gemma 3 4B costs 18× less per token, which makes it the better buy when GLM-4.5V's lead doesn't matter for your workload.

Last verified . 12 shared benchmarks.

Gemma 3 4B Google

28.1

Rank #326 Confirmed

GLM-4.5V Z.ai (Zhipu)

39.8

Rank #158 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemma 3 4B scores higher in 0 categories and GLM-4.5V in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.5V leads 37.5 to 11.8.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 25.2% for Gemma 3 4B and 59.8% for GLM-4.5V.
  • Gemma 3 4B is cheaper at $0.04 / $0.08 per million input/output tokens, against $0.60 / $1.80 for GLM-4.5V.
  • Gemma 3 4B accepts more context: 131K tokens versus 64K.

Side by side

Gemma 3 4B and GLM-4.5V specifications
Gemma 3 4BGLM-4.5V
ProviderGoogleZ.ai (Zhipu)
Noometry Index28.139.8
Released2025-03-122025-08-11
WeightsOpenOpen
Context window131K64K
Max output4K16K
Input $ / M tokens$0.04$0.60
Output $ / M tokens$0.08$1.80
Results tracked2215

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5V leads

Gemma 3 4B: 35.9 (#215), GLM-4.5V: 39.5 (#155)

Coding benchmarks
BenchmarkGemma 3 4BGLM-4.5V
LMArena Coding12301347

Agentic & Tool Use Not comparable

Gemma 3 4B: 20.9 (#142), GLM-4.5V: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 4BGLM-4.5V
Berkeley Function Calling Leaderboard19.6%—

Reasoning GLM-4.5V leads

Gemma 3 4B: 13.2 (#335), GLM-4.5V: 27.4 (#119)

Reasoning benchmarks
BenchmarkGemma 3 4BGLM-4.5V
Kagi LLM Benchmark25.2%59.8%
LMArena Hard Prompts12531334
Chess Puzzles0%—
DTBench50.9%—
LMCA2.8%—
Epoch Capabilities Index116.02—

Math GLM-4.5V leads

Gemma 3 4B: 16.8 (#292), GLM-4.5V: 37.4 (#159)

Math benchmarks
BenchmarkGemma 3 4BGLM-4.5V
LMArena Math12391354
OTIS Mock AIME 2024-20257.5%—

Knowledge GLM-4.5V leads

Gemma 3 4B: 11.8 (#299), GLM-4.5V: 37.5 (#156)

Knowledge benchmarks
BenchmarkGemma 3 4BGLM-4.5V
LMArena Expert12231353
GPQA Diamond23.2%—
Vectara Hallucination Rate6.4%—

Multimodal Not comparable

Gemma 3 4B: —, GLM-4.5V: 34.3 (#92)

Multimodal benchmarks
BenchmarkGemma 3 4BGLM-4.5V
LMArena Vision—1154

Multilingual GLM-4.5V leads

Gemma 3 4B: 42.5 (#194), GLM-4.5V: 44.6 (#177)

Multilingual benchmarks
BenchmarkGemma 3 4BGLM-4.5V
LMArena Non-English12731303
LMArena Russian12941298
LMArena Chinese—1337
LMArena German1281—
LMArena Spanish—1336

Instruction Following GLM-4.5V leads

Gemma 3 4B: 65.2 (#225), GLM-4.5V: 69.2 (#175)

Instruction Following benchmarks
BenchmarkGemma 3 4BGLM-4.5V
LMArena Instruction Following12391311

Long Context Too close to call

Gemma 3 4B: 38.7 (#194), GLM-4.5V: 39.6 (#171)

Long Context benchmarks
BenchmarkGemma 3 4BGLM-4.5V
LMArena Longer Query12731304

Writing & Preference GLM-4.5V leads

Gemma 3 4B: 42.0 (#239), GLM-4.5V: 52.5 (#170)

Writing & Preference benchmarks
BenchmarkGemma 3 4BGLM-4.5V
LMArena Text12911333
LMArena Creative Writing12711295
LMArena Multi-Turn12551332
EQ-Bench Creative Writing1068—

Frequently asked questions

Is Gemma 3 4B better than GLM-4.5V?

GLM-4.5V is the stronger model overall, scoring 39.8 to 28.1 on the Noometry Index. Gemma 3 4B costs 18× less per token, which makes it the better buy when GLM-4.5V's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 4B or GLM-4.5V?

Gemma 3 4B is cheaper. It lists at $0.04 per million input tokens and $0.08 per million output tokens; GLM-4.5V lists at $0.60 and $1.80.

Is Gemma 3 4B or GLM-4.5V better for coding?

GLM-4.5V scores higher on coding benchmarks: 39.5 versus 35.9 in the Noometry coding category.

Which has the bigger context window?

Gemma 3 4B does, with 131K tokens against 64K.

How many benchmarks do Gemma 3 4B and GLM-4.5V share?

12 benchmarks have published results for both models. Gemma 3 4B has 22 scored results on Noometry and GLM-4.5V has 15.

Related comparisons

Go deeper