Noometry

Model comparison

GLM-5.1 vs Grok 4.7

Grok 4.7 is the stronger model overall, scoring 53.1 to 47.8 on the Noometry Index.

Last verified . 28 shared benchmarks.

GLM-5.1 Z.ai (Zhipu)

47.8

Rank #59 Confirmed

Grok 4.7 xAI

53.1

Rank #37 Confirmed

Summary

  • They share 28 benchmarks with published results for both. GLM-5.1 scores higher in 3 categories and Grok 4.7 in 6 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in agentic & tool use, where Grok 4.7 leads 36.7 to 24.9.
  • The biggest single-benchmark swing is SimpleQA Verified: 34% for GLM-5.1 and 56% for Grok 4.7.
  • GLM-5.1 is cheaper at $1.40 / $4.40 per million input/output tokens, against $2 / $6 for Grok 4.7.
  • Grok 4.7 accepts more context: 500K tokens versus 200K.
  • GLM-5.1 has downloadable open weights; the other is API-only.

Side by side

GLM-5.1Grok 4.7
ProviderZ.ai (Zhipu)xAI
Noometry Index47.853.1
Released2026-04-072026-09-21
WeightsOpenProprietary
Context window200K500K
Max output131K500K
Input $ / M tokens$1.40$2
Output $ / M tokens$4.40$6
Results tracked4139

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.7 leads

GLM-5.1: 48.7 (#55), Grok 4.7: 58.0 (#18)

BenchmarkGLM-5.1Grok 4.7
LMArena WebDev15081639
SciCode43.8%57.8%
LMArena Coding14851427
SWE-bench Verified74.2%—
FrontierCode—47.6%
CursorBench—46.3%
FrontierSWE—29.5%
WeirdML57.1%—
ALE-Bench887.1—

Agentic & Tool Use Grok 4.7 leads

GLM-5.1: 24.9 (#113), Grok 4.7: 36.7 (#37)

BenchmarkGLM-5.1Grok 4.7
APEX-Agents40.9%54.6%
Vending-Bench 25,63410,537
ExploitBench18.1%—
GBAEval0%—
GDP.pdf—22.8%

Reasoning Grok 4.7 leads

GLM-5.1: 39.1 (#60), Grok 4.7: 49.1 (#40)

BenchmarkGLM-5.1Grok 4.7
NYT Connections (extended)77.7%76.8%
CritPt4.6%18%
Chess Puzzles19%38%
LMArena Hard Prompts14721413
Epoch Capabilities Index149.84153.53
SimpleBench55.1%—
Thematic Generalization69.8%—
Mystery Game Puzzles—29%
DTBench—96%
LMCA—49.4%

Math Grok 4.7 leads

GLM-5.1: 49.7 (#60), Grok 4.7: 57.8 (#39)

BenchmarkGLM-5.1Grok 4.7
FrontierMath (Tiers 1-3)36.8%53%
OTIS Mock AIME 2024-202593.3%98.1%
ProofBench22.2%34%
LMArena Math14731407
FrontierMath Tier 4—17.1%
MathArena Final-Answer Competitions67.1%—
FrontierMath (Feb 2025 set)33.4%—
FrontierMath Tier 4 (v1)12.5%—

Knowledge Grok 4.7 leads

GLM-5.1: 54.9 (#50), Grok 4.7: 62.8 (#22)

BenchmarkGLM-5.1Grok 4.7
GPQA Diamond89.9%92.7%
SimpleQA Verified34%56%
LMArena Expert14761422

Multimodal Not comparable

GLM-5.1: —, Grok 4.7: 35.5 (#87)

BenchmarkGLM-5.1Grok 4.7
LMArena Vision—1228
Blueprint-Bench 2—32.5%
Furniture Assembly—20.8%

Multilingual GLM-5.1 leads

GLM-5.1: 55.0 (#36), Grok 4.7: 50.8 (#116)

BenchmarkGLM-5.1Grok 4.7
LMArena Non-English14471389
LMArena Chinese15151455
LMArena French14741455
LMArena Russian14541397
LMArena Spanish14691400
LMArena German1465—
LMArena Japanese1434—
LMArena Korean1418—

Instruction Following GLM-5.1 leads

GLM-5.1: 76.3 (#42), Grok 4.7: 74.1 (#105)

BenchmarkGLM-5.1Grok 4.7
LMArena Instruction Following14511404

Long Context GLM-5.1 leads

GLM-5.1: 44.9 (#53), Grok 4.7: 43.1 (#104)

BenchmarkGLM-5.1Grok 4.7
LMArena Longer Query14661413

Writing & Preference Grok 4.7 leads

GLM-5.1: 66.9 (#31), Grok 4.7: 70.0 (#24)

BenchmarkGLM-5.1Grok 4.7
LMArena Text14611399
LMArena Creative Writing14531391
EQ-Bench Creative Writing15922007
LMArena Multi-Turn14721393

Frequently asked questions

Is GLM-5.1 better than Grok 4.7?

Grok 4.7 is the stronger model overall, scoring 53.1 to 47.8 on the Noometry Index.

Which is cheaper, GLM-5.1 or Grok 4.7?

GLM-5.1 is cheaper. It lists at $1.40 per million input tokens and $4.40 per million output tokens; Grok 4.7 lists at $2 and $6.

Is GLM-5.1 or Grok 4.7 better for coding?

Grok 4.7 scores higher on coding benchmarks: 58.0 versus 48.7 in the Noometry coding category.

Which has the bigger context window?

Grok 4.7 does, with 500K tokens against 200K.

How many benchmarks do GLM-5.1 and Grok 4.7 share?

28 benchmarks have published results for both models. GLM-5.1 has 41 scored results on Noometry and Grok 4.7 has 39.

Related comparisons

Go deeper