Model comparison

GLM-4.5-Air vs Grok 4.20 Multi-Agent

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 38.9 on the Noometry Index. GLM-4.5-Air costs 3.7× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Last verified October 12, 2026. 17 shared benchmarks.

GLM-4.5-Air Z.ai (Zhipu)

38.9

Rank #177 Confirmed

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Summary

They share 17 benchmarks with published results for both. GLM-4.5-Air scores higher in 0 categories and Grok 4.20 Multi-Agent in 8 categories; 8 gaps are clear of the uncertainty.
The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 24.1.
GLM-4.5-Air is cheaper at $0.20 / $1.10 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.
Grok 4.20 Multi-Agent accepts more context: 1M tokens versus 131K.
GLM-4.5-Air has downloadable open weights; the other is API-only.

Side by side

GLM-4.5-Air and Grok 4.20 Multi-Agent specifications
	GLM-4.5-Air	Grok 4.20 Multi-Agent
Provider	Z.ai (Zhipu)	xAI
Noometry Index	38.9	46.2
Released	2025-07-20	2026-03-09
Weights	Open	Proprietary
Context window	131K	1M
Max output	98K	30K
Input $ / M tokens	$0.20	$1.25
Output $ / M tokens	$1.10	$2.50
Results tracked	27	20

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

GLM-4.5-Air: 33.3 (#259), Grok 4.20 Multi-Agent: 43.0 (#92)

Coding benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Coding	1397	1457
GSO	2.9%	—

Agentic & Tool Use Not comparable

GLM-4.5-Air: —, Grok 4.20 Multi-Agent: —

Agentic & Tool Use benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Search	—	1204

Reasoning Grok 4.20 Multi-Agent leads

GLM-4.5-Air: 24.1 (#166), Grok 4.20 Multi-Agent: 43.9 (#48)

Reasoning benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Hard Prompts	1379	1448
Kagi LLM Benchmark	43%	—
NYT Connections (extended)	—	89.6%
ForecastBench	59.2	—

Math Grok 4.20 Multi-Agent leads

GLM-4.5-Air: 36.2 (#170), Grok 4.20 Multi-Agent: 39.4 (#104)

Math benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Math	1396	1442
Omni-MATH	39.1%	—

Knowledge Grok 4.20 Multi-Agent leads

GLM-4.5-Air: 35.0 (#191), Grok 4.20 Multi-Agent: 40.4 (#119)

Knowledge benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Expert	1370	1445
Humanity's Last Exam	8.1%	—
MMLU-Pro	76.2%	—
Vectara Hallucination Rate	9.3%	—
GPQA (HELM)	59.4%	—

Multimodal Not comparable

GLM-4.5-Air: —, Grok 4.20 Multi-Agent: 40.5 (#48)

Multimodal benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Vision	—	1259

Multilingual Grok 4.20 Multi-Agent leads

GLM-4.5-Air: 49.1 (#135), Grok 4.20 Multi-Agent: 54.4 (#43)

Multilingual benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Non-English	1366	1440
LMArena Chinese	1426	1475
LMArena French	1399	1466
LMArena German	1377	1456
LMArena Japanese	1348	1405
LMArena Korean	1308	1416
LMArena Russian	1373	1457
LMArena Spanish	1386	1447

Instruction Following Grok 4.20 Multi-Agent leads

GLM-4.5-Air: 69.6 (#171), Grok 4.20 Multi-Agent: 74.8 (#84)

Instruction Following benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Instruction Following	1354	1420
IFEval	81.2%	—

Long Context Grok 4.20 Multi-Agent leads

GLM-4.5-Air: 41.6 (#135), Grok 4.20 Multi-Agent: 43.7 (#88)

Long Context benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Longer Query	1366	1431

Writing & Preference Grok 4.20 Multi-Agent leads

GLM-4.5-Air: 55.9 (#139), Grok 4.20 Multi-Agent: 64.0 (#59)

Writing & Preference benchmarks
Benchmark	GLM-4.5-Air	Grok 4.20 Multi-Agent
LMArena Text	1384	1450
LMArena Creative Writing	1343	1436
LMArena Multi-Turn	1371	1452
WildBench	78.9%	—

Frequently asked questions

Is GLM-4.5-Air better than Grok 4.20 Multi-Agent?

Which is cheaper, GLM-4.5-Air or Grok 4.20 Multi-Agent?

GLM-4.5-Air is cheaper. It lists at $0.20 per million input tokens and $1.10 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is GLM-4.5-Air or Grok 4.20 Multi-Agent better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 43.0 versus 33.3 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 Multi-Agent does, with 1M tokens against 131K.

How many benchmarks do GLM-4.5-Air and Grok 4.20 Multi-Agent share?

17 benchmarks have published results for both models. GLM-4.5-Air has 27 scored results on Noometry and Grok 4.20 Multi-Agent has 20.