Noometry

Model comparison

Gemma 4 26B A4B IT vs GLM-4.5-Air

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.5 to 38.9 on the Noometry Index.

Last verified . 15 shared benchmarks.

Gemma 4 26B A4B IT Google

43.5

Rank #92 Confirmed

GLM-4.5-Air Z.ai (Zhipu)

38.9

Rank #177 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Gemma 4 26B A4B IT scores higher in 7 categories and GLM-4.5-Air in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemma 4 26B A4B IT leads 47.6 to 36.2.
  • Gemma 4 26B A4B IT is cheaper at $0.09 / $0.30 per million input/output tokens, against $0.20 / $1.10 for GLM-4.5-Air.
  • Gemma 4 26B A4B IT accepts more context: 262K tokens versus 131K.

Side by side

Gemma 4 26B A4B ITGLM-4.5-Air
ProviderGoogleZ.ai (Zhipu)
Noometry Index43.538.9
Released2026-04-022025-07-20
WeightsOpenOpen
Context window262K131K
Max output33K98K
Input $ / M tokens$0.09$0.20
Output $ / M tokens$0.30$1.10
Results tracked2827

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 39.0 (#164), GLM-4.5-Air: 33.3 (#259)

BenchmarkGemma 4 26B A4B ITGLM-4.5-Air
LMArena Coding14471397
LMArena WebDev1359—
SciCode40%—
GSO—2.9%
WeirdML35.2%—
ALE-Bench927.17—

Reasoning GLM-4.5-Air leads

Gemma 4 26B A4B IT: 21.8 (#213), GLM-4.5-Air: 24.1 (#166)

BenchmarkGemma 4 26B A4B ITGLM-4.5-Air
LMArena Hard Prompts14391379
Kagi LLM Benchmark—43%
CritPt0%—
Chess Puzzles6%—
DTBench74.9%—
LMCA29.7%—
Epoch Capabilities Index141.85—
ForecastBench—59.2

Math Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 47.6 (#67), GLM-4.5-Air: 36.2 (#170)

BenchmarkGemma 4 26B A4B ITGLM-4.5-Air
LMArena Math14701396
OTIS Mock AIME 2024-202582.2%—
Omni-MATH—39.1%

Knowledge Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 45.7 (#85), GLM-4.5-Air: 35.0 (#191)

BenchmarkGemma 4 26B A4B ITGLM-4.5-Air
Vectara Hallucination Rate5.2%9.3%
LMArena Expert14471370
GPQA Diamond73.2%—
Humanity's Last Exam—8.1%
MMLU-Pro—76.2%
GPQA (HELM)—59.4%

Multimodal Not comparable

Gemma 4 26B A4B IT: 40.6 (#46), GLM-4.5-Air: —

BenchmarkGemma 4 26B A4B ITGLM-4.5-Air
LMArena Vision1260—

Multilingual Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 53.1 (#71), GLM-4.5-Air: 49.1 (#135)

BenchmarkGemma 4 26B A4B ITGLM-4.5-Air
LMArena Non-English14211366
LMArena Chinese14951426
LMArena French14601399
LMArena Russian14341373
LMArena Spanish14171386
LMArena German—1377
LMArena Japanese—1348
LMArena Korean—1308

Instruction Following Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 74.8 (#82), GLM-4.5-Air: 69.6 (#171)

BenchmarkGemma 4 26B A4B ITGLM-4.5-Air
LMArena Instruction Following14201354
IFEval—81.2%

Long Context Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 43.6 (#91), GLM-4.5-Air: 41.6 (#135)

BenchmarkGemma 4 26B A4B ITGLM-4.5-Air
LMArena Longer Query14281366

Writing & Preference Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 58.6 (#115), GLM-4.5-Air: 55.9 (#139)

BenchmarkGemma 4 26B A4B ITGLM-4.5-Air
LMArena Text14341384
LMArena Creative Writing14021343
LMArena Multi-Turn14411371
EQ-Bench Creative Writing1305—
WildBench—78.9%

Frequently asked questions

Is Gemma 4 26B A4B IT better than GLM-4.5-Air?

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.5 to 38.9 on the Noometry Index.

Which is cheaper, Gemma 4 26B A4B IT or GLM-4.5-Air?

Gemma 4 26B A4B IT is cheaper. It lists at $0.09 per million input tokens and $0.30 per million output tokens; GLM-4.5-Air lists at $0.20 and $1.10.

Is Gemma 4 26B A4B IT or GLM-4.5-Air better for coding?

Gemma 4 26B A4B IT scores higher on coding benchmarks: 39.0 versus 33.3 in the Noometry coding category.

Which has the bigger context window?

Gemma 4 26B A4B IT does, with 262K tokens against 131K.

How many benchmarks do Gemma 4 26B A4B IT and GLM-4.5-Air share?

15 benchmarks have published results for both models. Gemma 4 26B A4B IT has 28 scored results on Noometry and GLM-4.5-Air has 27.

Related comparisons

Go deeper