Noometry

Model comparison

GLM-5.3-Flash vs Grok 4.20 Multi-Agent

GLM-5.3-Flash is the stronger model overall, scoring 51.8 to 46.2 on the Noometry Index.

Last verified . 18 shared benchmarks.

GLM-5.3-Flash Z.ai (Zhipu)

51.8

Rank #41 Confirmed

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Summary

  • They share 18 benchmarks with published results for both. GLM-5.3-Flash scores higher in 9 categories and Grok 4.20 Multi-Agent in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-5.3-Flash leads 58.4 to 40.4.
  • GLM-5.3-Flash is cheaper at $0.15 / $0.50 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.
  • GLM-5.3-Flash has downloadable open weights; the other is API-only.

Side by side

GLM-5.3-FlashGrok 4.20 Multi-Agent
ProviderZ.ai (Zhipu)xAI
Noometry Index51.846.2
Released2026-08-202026-03-09
WeightsOpenProprietary
Context window1M1M
Max output131K30K
Input $ / M tokens$0.15$1.25
Output $ / M tokens$0.50$2.50
Results tracked4020

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.3-Flash leads

GLM-5.3-Flash: 53.1 (#31), Grok 4.20 Multi-Agent: 43.0 (#92)

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
LMArena Coding15081457
DeepSWE63.4%—
FrontierCode31.8%—
CursorBench36.8%—
LMArena WebDev1609—
FrontierSWE18.1%—
SciCode51.6%—
ALE-Bench303.55—

Agentic & Tool Use Not comparable

GLM-5.3-Flash: 34.2 (#47), Grok 4.20 Multi-Agent: —

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
APEX-Agents52.8%—
GDP.pdf14%—
LMArena Search—1204

Reasoning GLM-5.3-Flash leads

GLM-5.3-Flash: 48.0 (#42), Grok 4.20 Multi-Agent: 43.9 (#48)

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
LMArena Hard Prompts14911448
ARC-AGI-265.8%—
NYT Connections (extended)—89.6%
ARC-AGI-191%—
CritPt15.4%—
Chess Puzzles14%—
Mystery Game Puzzles8%—
Surface Evolver Bench52.5%—
Bench to the Future 30.15—
Epoch Capabilities Index151.88—

Math GLM-5.3-Flash leads

GLM-5.3-Flash: 53.3 (#47), Grok 4.20 Multi-Agent: 39.4 (#104)

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
LMArena Math15001442
FrontierMath (Tiers 1-3)55.8%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202593.9%—
ProofBench21%—

Knowledge GLM-5.3-Flash leads

GLM-5.3-Flash: 58.4 (#36), Grok 4.20 Multi-Agent: 40.4 (#119)

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
LMArena Expert15131445
GPQA Diamond90.2%—

Multimodal GLM-5.3-Flash leads

GLM-5.3-Flash: 42.8 (#27), Grok 4.20 Multi-Agent: 40.5 (#48)

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
LMArena Vision12961259

Multilingual GLM-5.3-Flash leads

GLM-5.3-Flash: 56.0 (#25), Grok 4.20 Multi-Agent: 54.4 (#43)

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
LMArena Non-English14621440
LMArena Chinese15271475
LMArena French14961466
LMArena German14701456
LMArena Japanese14291405
LMArena Korean14461416
LMArena Russian14691457
LMArena Spanish14711447

Instruction Following GLM-5.3-Flash leads

GLM-5.3-Flash: 77.5 (#20), Grok 4.20 Multi-Agent: 74.8 (#84)

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
LMArena Instruction Following14781420

Long Context GLM-5.3-Flash leads

GLM-5.3-Flash: 45.4 (#39), Grok 4.20 Multi-Agent: 43.7 (#88)

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
LMArena Longer Query14821431

Writing & Preference GLM-5.3-Flash leads

GLM-5.3-Flash: 65.3 (#50), Grok 4.20 Multi-Agent: 64.0 (#59)

BenchmarkGLM-5.3-FlashGrok 4.20 Multi-Agent
LMArena Text14711450
LMArena Creative Writing14421436
LMArena Multi-Turn14671452

Frequently asked questions

Is GLM-5.3-Flash better than Grok 4.20 Multi-Agent?

GLM-5.3-Flash is the stronger model overall, scoring 51.8 to 46.2 on the Noometry Index.

Which is cheaper, GLM-5.3-Flash or Grok 4.20 Multi-Agent?

GLM-5.3-Flash is cheaper. It lists at $0.15 per million input tokens and $0.50 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is GLM-5.3-Flash or Grok 4.20 Multi-Agent better for coding?

GLM-5.3-Flash scores higher on coding benchmarks: 53.1 versus 43.0 in the Noometry coding category.

Which has the bigger context window?

Both accept 1M tokens.

How many benchmarks do GLM-5.3-Flash and Grok 4.20 Multi-Agent share?

18 benchmarks have published results for both models. GLM-5.3-Flash has 40 scored results on Noometry and Grok 4.20 Multi-Agent has 20.

Related comparisons

Go deeper