Noometry

Model comparison

Gemma 4 26B A4B IT vs GLM-4.5

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.1 to 41.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemma 4 26B A4B IT Google

43.1

Rank #88 Confirmed

GLM-4.5 Z.ai (Zhipu)

41.4

Rank #125 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemma 4 26B A4B IT scores higher in 6 categories and GLM-4.5 in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemma 4 26B A4B IT leads 45.6 to 35.5.
  • The biggest single-benchmark swing is WeirdML: 35.2% for Gemma 4 26B A4B IT and 40.6% for GLM-4.5.
  • Gemma 4 26B A4B IT is cheaper at $0.0765 / $0.26 per million input/output tokens, against $0.60 / $2.20 for GLM-4.5.
  • Gemma 4 26B A4B IT accepts more context: 262K tokens versus 131K.

Side by side

Gemma 4 26B A4B ITGLM-4.5
ProviderGoogleZ.ai (Zhipu)
Noometry Index43.141.4
Released2026-04-022025-07-27
WeightsOpenOpen
Context window262K131K
Max output33K98K
Input $ / M tokens$0.0765$0.60
Output $ / M tokens$0.26$2.20
Results tracked2827

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5 leads

Gemma 4 26B A4B IT: 38.8 (#156), GLM-4.5: 41.1 (#121)

BenchmarkGemma 4 26B A4B ITGLM-4.5
WeirdML35.2%40.6%
LMArena Coding14461434
ALE-Bench927.17344.82
SWE-bench Verified (bash only)—54.2%
LMArena WebDev1359—
SciCode40%—
AlgoTune—1.52

Reasoning GLM-4.5 leads

Gemma 4 26B A4B IT: 21.1 (#205), GLM-4.5: 27.7 (#99)

BenchmarkGemma 4 26B A4B ITGLM-4.5
LMArena Hard Prompts14381430
Kagi LLM Benchmark—57.9%
CritPt0%—
Chess Puzzles6%—
DTBench74.9%—
LMCA29.7%—
Epoch Capabilities Index141.85—

Math Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 45.7 (#61), GLM-4.5: 36.3 (#119)

BenchmarkGemma 4 26B A4B ITGLM-4.5
LMArena Math14691427
OTIS Mock AIME 2024-202582.2%—

Knowledge Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 45.6 (#79), GLM-4.5: 35.5 (#172)

BenchmarkGemma 4 26B A4B ITGLM-4.5
LMArena Expert14471433
GPQA Diamond73.2%—
Humanity's Last Exam—8.3%
Confabulations—11.3%
Vectara Hallucination Rate5.2%—

Multimodal Not comparable

Gemma 4 26B A4B IT: 39.9 (#43), GLM-4.5: —

BenchmarkGemma 4 26B A4B ITGLM-4.5
LMArena Vision1260—

Multilingual Too close to call

Gemma 4 26B A4B IT: 53.3 (#68), GLM-4.5: 53.0 (#74)

BenchmarkGemma 4 26B A4B ITGLM-4.5
LMArena Non-English14221417
LMArena Chinese14951465
LMArena French14591423
LMArena Russian14341414
LMArena Spanish14151454
LMArena German—1406
LMArena Japanese—1416
LMArena Korean—1382

Instruction Following Too close to call

Gemma 4 26B A4B IT: 75.0 (#78), GLM-4.5: 74.3 (#100)

BenchmarkGemma 4 26B A4B ITGLM-4.5
LMArena Instruction Following14201405

Long Context Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 43.6 (#87), GLM-4.5: 38.2 (#196)

BenchmarkGemma 4 26B A4B ITGLM-4.5
LMArena Longer Query14271413
Fiction.LiveBench—58.3%

Writing & Preference Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 58.8 (#110), GLM-4.5: 57.7 (#121)

BenchmarkGemma 4 26B A4B ITGLM-4.5
LMArena Text14341430
LMArena Creative Writing14011395
EQ-Bench Creative Writing13051343
LMArena Multi-Turn14421415
Short-Story Creative Writing—73.4%

Frequently asked questions

Is Gemma 4 26B A4B IT better than GLM-4.5?

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.1 to 41.4 on the Noometry Index.

Which is cheaper, Gemma 4 26B A4B IT or GLM-4.5?

Gemma 4 26B A4B IT is cheaper. It lists at $0.0765 per million input tokens and $0.26 per million output tokens; GLM-4.5 lists at $0.60 and $2.20.

Is Gemma 4 26B A4B IT or GLM-4.5 better for coding?

GLM-4.5 scores higher on coding benchmarks: 41.1 versus 38.8 in the Noometry coding category.

Which has the bigger context window?

Gemma 4 26B A4B IT does, with 262K tokens against 131K.

How many benchmarks do Gemma 4 26B A4B IT and GLM-4.5 share?

17 benchmarks have published results for both models. Gemma 4 26B A4B IT has 28 scored results on Noometry and GLM-4.5 has 27.

Related comparisons

Go deeper