Model comparison

GLM-5.2 vs Grok 2 Mini 2024 08 13

GLM-5.2 is the stronger model overall, scoring 51.1 to 37.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

GLM-5.2 Z.ai (Zhipu)

51.1

Rank #44 Confirmed

Grok 2 Mini 2024 08 13 xAI

37.7

Rank #198 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GLM-5.2 scores higher in 8 categories and Grok 2 Mini 2024 08 13 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-5.2 leads 57.1 to 33.9.
  • GLM-5.2 has downloadable open weights; the other is API-only.

Side by side

GLM-5.2 and Grok 2 Mini 2024 08 13 specifications
GLM-5.2Grok 2 Mini 2024 08 13
ProviderZ.ai (Zhipu)xAI
Noometry Index51.137.7
Released2026-06-132024-08-13
WeightsOpenProprietary
Context window1M—
Max output131K—
Input $ / M tokens$1.40—
Output $ / M tokens$4.40—
Results tracked5117

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.2 leads

GLM-5.2: 51.3 (#41), Grok 2 Mini 2024 08 13: 37.0 (#199)

Coding benchmarks
BenchmarkGLM-5.2Grok 2 Mini 2024 08 13
LMArena Coding14851269
SWE-bench Verified78.7%—
DeepSWE43.8%—
FrontierCode24.5%—
LMArena WebDev1603—
SciCode50.5%—
WeirdML70.1%—
ALE-Bench1,047—

Agentic & Tool Use Not comparable

GLM-5.2: 32.4 (#63), Grok 2 Mini 2024 08 13: —

Agentic & Tool Use benchmarks
BenchmarkGLM-5.2Grok 2 Mini 2024 08 13
APEX-Agents45.2%—
τ²-bench Banking37.1%—
PostTrainBench31.7%—
GBAEval0%—
Vending-Bench 28,314—

Reasoning GLM-5.2 leads

GLM-5.2: 42.3 (#52), Grok 2 Mini 2024 08 13: 24.8 (#159)

Reasoning benchmarks
BenchmarkGLM-5.2Grok 2 Mini 2024 08 13
LMArena Hard Prompts14801255
ARC-AGI-222.8%—
SimpleBench58.8%—
Kagi LLM Benchmark62.6%—
NYT Connections (extended)74.3%—
ARC-AGI-177%—
CritPt20.9%—
Chess Puzzles21%—
EBR-Bench9.5%—
Mystery Game Puzzles19%—
DTBench93.6%—
LMCA45.8%—
Surface Evolver Bench55.6%—
Epoch Capabilities Index151.78—

Math GLM-5.2 leads

GLM-5.2: 55.7 (#43), Grok 2 Mini 2024 08 13: 35.4 (#185)

Math benchmarks
BenchmarkGLM-5.2Grok 2 Mini 2024 08 13
LMArena Math14821265
FrontierMath (Tiers 1-3)59.2%—
FrontierMath Tier 429.3%—
MathArena Final-Answer Competitions67.6%—
OTIS Mock AIME 2024-202586.4%—
ProofBench35%—

Knowledge GLM-5.2 leads

GLM-5.2: 57.1 (#40), Grok 2 Mini 2024 08 13: 33.9 (#200)

Knowledge benchmarks
BenchmarkGLM-5.2Grok 2 Mini 2024 08 13
LMArena Expert14861238
GPQA Diamond91.9%—
SimpleQA Verified34.2%—

Multilingual GLM-5.2 leads

GLM-5.2: 55.8 (#26), Grok 2 Mini 2024 08 13: 41.4 (#208)

Multilingual benchmarks
BenchmarkGLM-5.2Grok 2 Mini 2024 08 13
LMArena Non-English14591257
LMArena Chinese15191262
LMArena French14791286
LMArena German14681273
LMArena Japanese14511213
LMArena Korean14451195
LMArena Russian14661261
LMArena Spanish14771279

Instruction Following GLM-5.2 leads

GLM-5.2: 76.9 (#34), Grok 2 Mini 2024 08 13: 65.5 (#220)

Instruction Following benchmarks
BenchmarkGLM-5.2Grok 2 Mini 2024 08 13
LMArena Instruction Following14651245

Long Context GLM-5.2 leads

GLM-5.2: 45.3 (#43), Grok 2 Mini 2024 08 13: 38.4 (#196)

Long Context benchmarks
BenchmarkGLM-5.2Grok 2 Mini 2024 08 13
LMArena Longer Query14791266

Writing & Preference GLM-5.2 leads

GLM-5.2: 70.4 (#21), Grok 2 Mini 2024 08 13: 47.3 (#211)

Writing & Preference benchmarks
BenchmarkGLM-5.2Grok 2 Mini 2024 08 13
LMArena Text14701281
LMArena Creative Writing14621242
LMArena Multi-Turn14691265
EQ-Bench Creative Writing1757—
EQ-Bench 41222—

Frequently asked questions

Is GLM-5.2 better than Grok 2 Mini 2024 08 13?

GLM-5.2 is the stronger model overall, scoring 51.1 to 37.7 on the Noometry Index.

Is GLM-5.2 or Grok 2 Mini 2024 08 13 better for coding?

GLM-5.2 scores higher on coding benchmarks: 51.3 versus 37.0 in the Noometry coding category.

How many benchmarks do GLM-5.2 and Grok 2 Mini 2024 08 13 share?

17 benchmarks have published results for both models. GLM-5.2 has 51 scored results on Noometry and Grok 2 Mini 2024 08 13 has 17.

Related comparisons

Go deeper