Noometry

Model comparison

GLM-4.7 vs GPT-3.5-turbo

GLM-4.7 is the stronger model overall, scoring 42.0 to 23.2 on the Noometry Index.

Last verified . 22 shared benchmarks.

GLM-4.7 Z.ai (Zhipu)

42.0

Rank #124 Confirmed

GPT-3.5-turbo OpenAI

23.2

Rank #350 Confirmed

Summary

  • They share 22 benchmarks with published results for both. GLM-4.7 scores higher in 8 categories and GPT-3.5-turbo in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.7 leads 47.0 to 10.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 83.3% for GLM-4.7 and 2.2% for GPT-3.5-turbo.
  • GPT-3.5-turbo is cheaper at $0.50 / $1.50 per million input/output tokens, against $0.60 / $2.20 for GLM-4.7.
  • GLM-4.7 accepts more context: 205K tokens versus 16K.
  • GLM-4.7 has downloadable open weights; the other is API-only.

Side by side

GLM-4.7GPT-3.5-turbo
ProviderZ.ai (Zhipu)OpenAI
Noometry Index42.023.2
Released2025-12-222023-03-01
WeightsOpenProprietary
Context window205K16K
Max output131K4K
Input $ / M tokens$0.60$0.50
Output $ / M tokens$2.20$1.50
Results tracked3644

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.7 leads

GLM-4.7: 44.0 (#79), GPT-3.5-turbo: 23.9 (#331)

BenchmarkGLM-4.7GPT-3.5-turbo
LMArena Coding14541136
LMArena WebDev1435—
SciCode45.1%—
WeirdML—3.5%
BigCodeBench Instruct—39.1%
BigCodeBench Complete—50.6%
ALE-Bench399.48—
HumanEval+—70.7%
MBPP+—69.7%

Agentic & Tool Use Not comparable

GLM-4.7: 26.5 (#103), GPT-3.5-turbo: —

BenchmarkGLM-4.7GPT-3.5-turbo
Terminal-Bench33.4%—
METR Time Horizons—21.5%
Vending-Bench 22,377—

Reasoning GLM-4.7 leads

GLM-4.7: 24.3 (#164), GPT-3.5-turbo: 13.8 (#332)

BenchmarkGLM-4.7GPT-3.5-turbo
Chess Puzzles6%0%
LMArena Hard Prompts14431108
Epoch Capabilities Index143.51118.55
SimpleBench47.7%—
CritPt1.7%—
Mystery Game Puzzles—3%
DTBench—48.5%
LMCA—9.7%
Adversarial NLI—58.1%
BIG-Bench Hard—61.6%
CommonsenseQA 2.0—57%
ForecastBench—50.4
WinoGrande—81.6%

Math GLM-4.7 leads

GLM-4.7: 38.6 (#135), GPT-3.5-turbo: 6.3 (#327)

BenchmarkGLM-4.7GPT-3.5-turbo
OTIS Mock AIME 2024-202583.3%2.2%
LMArena Math14231142
FrontierMath (Tiers 1-3)—0%
ProofBench6%—
MATH Level 5—15.9%
FrontierMath (Feb 2025 set)2.4%—
FrontierMath Tier 4 (v1)0%—
GSM8K—57.8%

Knowledge GLM-4.7 leads

GLM-4.7: 47.0 (#80), GPT-3.5-turbo: 10.0 (#303)

BenchmarkGLM-4.7GPT-3.5-turbo
GPQA Diamond83.3%28%
LMArena Expert14241070
SimpleQA Verified32.2%—
Vectara Hallucination Rate11.7%—
ARC (AI2) Challenge—87.4%
BoolQ—87%
MMLU—71.4%
OpenBookQA—86%
TriviaQA—85.8%

Multilingual GLM-4.7 leads

GLM-4.7: 52.8 (#79), GPT-3.5-turbo: 31.5 (#258)

BenchmarkGLM-4.7GPT-3.5-turbo
LMArena Non-English14171108
LMArena Chinese14951075
LMArena French14321118
LMArena German14241090
LMArena Japanese14391043
LMArena Korean13991019
LMArena Russian14231123
LMArena Spanish14341121

Instruction Following GLM-4.7 leads

GLM-4.7: 74.4 (#95), GPT-3.5-turbo: 57.9 (#262)

BenchmarkGLM-4.7GPT-3.5-turbo
LMArena Instruction Following14111119

Long Context GLM-4.7 leads

GLM-4.7: 42.8 (#116), GPT-3.5-turbo: 34.0 (#254)

BenchmarkGLM-4.7GPT-3.5-turbo
LMArena Longer Query14321121
CL-bench15.9%—
CL-bench Life10.9%—

Writing & Preference GLM-4.7 leads

GLM-4.7: 60.9 (#93), GPT-3.5-turbo: 25.3 (#305)

BenchmarkGLM-4.7GPT-3.5-turbo
LMArena Text14351125
LMArena Creative Writing14011092
EQ-Bench Creative Writing1413451
LMArena Multi-Turn14461117

Frequently asked questions

Is GLM-4.7 better than GPT-3.5-turbo?

GLM-4.7 is the stronger model overall, scoring 42.0 to 23.2 on the Noometry Index.

Which is cheaper, GLM-4.7 or GPT-3.5-turbo?

GPT-3.5-turbo is cheaper. It lists at $0.50 per million input tokens and $1.50 per million output tokens; GLM-4.7 lists at $0.60 and $2.20.

Is GLM-4.7 or GPT-3.5-turbo better for coding?

GLM-4.7 scores higher on coding benchmarks: 44.0 versus 23.9 in the Noometry coding category.

Which has the bigger context window?

GLM-4.7 does, with 205K tokens against 16K.

How many benchmarks do GLM-4.7 and GPT-3.5-turbo share?

22 benchmarks have published results for both models. GLM-4.7 has 36 scored results on Noometry and GPT-3.5-turbo has 44.

Related comparisons

Go deeper