Noometry

Model comparison

Gemma 3 4B vs GLM-4.7-Flash

GLM-4.7-Flash is the stronger model overall, scoring 38.8 to 28.1 on the Noometry Index. Gemma 3 4B costs 2.9× less per token, which makes it the better buy when GLM-4.7-Flash's lead doesn't matter for your workload.

Last verified . 17 shared benchmarks.

Gemma 3 4B Google

28.1

Rank #326 Confirmed

GLM-4.7-Flash Z.ai (Zhipu)

38.8

Rank #180 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemma 3 4B scores higher in 0 categories and GLM-4.7-Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.7-Flash leads 35.5 to 11.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 7.5% for Gemma 3 4B and 58.3% for GLM-4.7-Flash.
  • Gemma 3 4B is cheaper at $0.04 / $0.08 per million input/output tokens, against $0.06 / $0.40 for GLM-4.7-Flash.
  • GLM-4.7-Flash accepts more context: 200K tokens versus 131K.

Side by side

Gemma 3 4BGLM-4.7-Flash
ProviderGoogleZ.ai (Zhipu)
Noometry Index28.138.8
Released2025-03-122026-01-19
WeightsOpenOpen
Context window131K200K
Max output4K131K
Input $ / M tokens$0.04$0.06
Output $ / M tokens$0.08$0.40
Results tracked2221

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.7-Flash leads

Gemma 3 4B: 35.9 (#215), GLM-4.7-Flash: 40.6 (#135)

BenchmarkGemma 3 4BGLM-4.7-Flash
LMArena Coding12301383

Agentic & Tool Use Not comparable

Gemma 3 4B: 20.9 (#142), GLM-4.7-Flash: —

BenchmarkGemma 3 4BGLM-4.7-Flash
Berkeley Function Calling Leaderboard19.6%—

Reasoning GLM-4.7-Flash leads

Gemma 3 4B: 13.2 (#335), GLM-4.7-Flash: 20.9 (#229)

BenchmarkGemma 3 4BGLM-4.7-Flash
Chess Puzzles0%0%
LMArena Hard Prompts12531356
Kagi LLM Benchmark25.2%—
DTBench50.9%—
LMCA2.8%—
Epoch Capabilities Index116.02—

Math GLM-4.7-Flash leads

Gemma 3 4B: 16.8 (#292), GLM-4.7-Flash: 36.1 (#173)

BenchmarkGemma 3 4BGLM-4.7-Flash
OTIS Mock AIME 2024-20257.5%58.3%
LMArena Math12391355

Knowledge GLM-4.7-Flash leads

Gemma 3 4B: 11.8 (#299), GLM-4.7-Flash: 35.5 (#184)

BenchmarkGemma 3 4BGLM-4.7-Flash
GPQA Diamond23.2%60.5%
Vectara Hallucination Rate6.4%9.3%
LMArena Expert12231357

Multilingual GLM-4.7-Flash leads

Gemma 3 4B: 42.5 (#194), GLM-4.7-Flash: 46.5 (#158)

BenchmarkGemma 3 4BGLM-4.7-Flash
LMArena Non-English12731330
LMArena German12811337
LMArena Russian12941332
LMArena Chinese—1403
LMArena French—1332
LMArena Korean—1283
LMArena Spanish—1350

Instruction Following GLM-4.7-Flash leads

Gemma 3 4B: 65.2 (#225), GLM-4.7-Flash: 70.1 (#167)

BenchmarkGemma 3 4BGLM-4.7-Flash
LMArena Instruction Following12391327

Long Context GLM-4.7-Flash leads

Gemma 3 4B: 38.7 (#194), GLM-4.7-Flash: 40.9 (#148)

BenchmarkGemma 3 4BGLM-4.7-Flash
LMArena Longer Query12731345

Writing & Preference GLM-4.7-Flash leads

Gemma 3 4B: 42.0 (#239), GLM-4.7-Flash: 47.4 (#210)

BenchmarkGemma 3 4BGLM-4.7-Flash
LMArena Text12911351
LMArena Creative Writing12711297
EQ-Bench Creative Writing10681125
LMArena Multi-Turn12551342

Frequently asked questions

Is Gemma 3 4B better than GLM-4.7-Flash?

GLM-4.7-Flash is the stronger model overall, scoring 38.8 to 28.1 on the Noometry Index. Gemma 3 4B costs 2.9× less per token, which makes it the better buy when GLM-4.7-Flash's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 4B or GLM-4.7-Flash?

Gemma 3 4B is cheaper. It lists at $0.04 per million input tokens and $0.08 per million output tokens; GLM-4.7-Flash lists at $0.06 and $0.40.

Is Gemma 3 4B or GLM-4.7-Flash better for coding?

GLM-4.7-Flash scores higher on coding benchmarks: 40.6 versus 35.9 in the Noometry coding category.

Which has the bigger context window?

GLM-4.7-Flash does, with 200K tokens against 131K.

How many benchmarks do Gemma 3 4B and GLM-4.7-Flash share?

17 benchmarks have published results for both models. Gemma 3 4B has 22 scored results on Noometry and GLM-4.7-Flash has 21.

Related comparisons

Go deeper