Noometry

Model comparison

GLM-5 vs GPT-4

GLM-5 is the stronger model overall, scoring 46.1 to 29.1 on the Noometry Index.

Last verified . 24 shared benchmarks.

GLM-5 Z.ai (Zhipu)

46.1

Rank #66 Confirmed

GPT-4 OpenAI

29.1

Rank #316 Confirmed

Summary

  • They share 24 benchmarks with published results for both. GLM-5 scores higher in 8 categories and GPT-4 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-5 leads 46.4 to 10.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 80% for GLM-5 and 1.1% for GPT-4.
  • GLM-5 is cheaper at $1 / $3.20 per million input/output tokens, against $30 / $60 for GPT-4.
  • GLM-5 accepts more context: 205K tokens versus 8K.
  • GLM-5 has downloadable open weights; the other is API-only.

Side by side

GLM-5GPT-4
ProviderZ.ai (Zhipu)OpenAI
Noometry Index46.129.1
Released2026-02-112023-03-14
WeightsOpenProprietary
Context window205K8K
Max output131K8K
Input $ / M tokens$1$30
Output $ / M tokens$3.20$60
Results tracked4538

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5 leads

GLM-5: 49.0 (#52), GPT-4: 31.6 (#283)

BenchmarkGLM-5GPT-4
WeirdML48.2%12.4%
LMArena Coding14611254
SWE-bench Verified72.1%—
SWE-bench Verified (bash only)72.8%—
LMArena WebDev1434—
SWE-bench Multilingual69.7%—
BigCodeBench Instruct—46%
BigCodeBench Complete—57.2%
ALE-Bench765.62—
HumanEval+—79.3%

Agentic & Tool Use Not comparable

GLM-5: 31.1 (#71), GPT-4: —

BenchmarkGLM-5GPT-4
Terminal-Bench52.4%—
τ²-bench Airline82.5%—
τ²-bench Banking9.8%—
τ²-bench Retail73.7%—
τ²-bench Telecom86.8%—
METR Time Horizons—36.1%
Vending-Bench 24,432—

Reasoning GLM-5 leads

GLM-5: 27.6 (#116), GPT-4: 17.8 (#289)

BenchmarkGLM-5GPT-4
Chess Puzzles10%4%
LMArena Hard Prompts14521241
Epoch Capabilities Index145.83125.89
ForecastBench6157.8
ARC-AGI-24.9%—
SimpleBench53.2%—
Kagi LLM Benchmark75%—
NYT Connections (extended)74.8%—
ARC-AGI-144.7%—
Mystery Game Puzzles—12%
DTBench—62.7%
LMCA—17.1%
BIG-Bench Hard—75.1%
HellaSwag—95.3%
WinoGrande—87.5%

Math GLM-5 leads

GLM-5: 46.4 (#71), GPT-4: 10.8 (#309)

BenchmarkGLM-5GPT-4
OTIS Mock AIME 2024-202580%1.1%
LMArena Math14401269
MathArena Final-Answer Competitions65.7%—
MATH Level 5—23%
FrontierMath (Feb 2025 set)16.4%—
FrontierMath Tier 4 (v1)2.1%—
GSM8K—92%

Knowledge GLM-5 leads

GLM-5: 52.3 (#64), GPT-4: 18.4 (#282)

BenchmarkGLM-5GPT-4
GPQA Diamond87.8%35.7%
LMArena Expert14541211
Vectara Hallucination Rate10.1%—
MMLU—86.4%
TriviaQA—84.8%

Multilingual GLM-5 leads

GLM-5: 53.7 (#58), GPT-4: 40.6 (#215)

BenchmarkGLM-5GPT-4
LMArena Non-English14301246
LMArena Chinese15111242
LMArena French14551283
LMArena German14451251
LMArena Japanese14161209
LMArena Korean14231184
LMArena Russian14361251
LMArena Spanish14541261

Instruction Following GLM-5 leads

GLM-5: 75.2 (#67), GPT-4: 65.3 (#222)

BenchmarkGLM-5GPT-4
LMArena Instruction Following14281241

Long Context GLM-5 leads

GLM-5: 44.7 (#60), GPT-4: 37.7 (#212)

BenchmarkGLM-5GPT-4
LMArena Longer Query14461244
CL-bench18.7%—

Writing & Preference GLM-5 leads

GLM-5: 66.0 (#38), GPT-4: 34.9 (#268)

BenchmarkGLM-5GPT-4
LMArena Text14461263
LMArena Creative Writing14391244
EQ-Bench Creative Writing1601752
LMArena Multi-Turn14561257

Frequently asked questions

Is GLM-5 better than GPT-4?

GLM-5 is the stronger model overall, scoring 46.1 to 29.1 on the Noometry Index.

Which is cheaper, GLM-5 or GPT-4?

GLM-5 is cheaper. It lists at $1 per million input tokens and $3.20 per million output tokens; GPT-4 lists at $30 and $60.

Is GLM-5 or GPT-4 better for coding?

GLM-5 scores higher on coding benchmarks: 49.0 versus 31.6 in the Noometry coding category.

Which has the bigger context window?

GLM-5 does, with 205K tokens against 8K.

How many benchmarks do GLM-5 and GPT-4 share?

24 benchmarks have published results for both models. GLM-5 has 45 scored results on Noometry and GPT-4 has 38.

Related comparisons

Go deeper