Noometry

Model comparison

Claude 3.7 Sonnet vs GLM-4.7-Flash

Claude 3.7 Sonnet and GLM-4.7-Flash score almost the same on the Noometry Index (39.4 vs 38.4), so choose on price, context window or the category you care about most.

Last verified . 19 shared benchmarks.

Claude 3.7 Sonnet Anthropic

39.4

Rank #154 Confirmed

GLM-4.7-Flash Z.ai (Zhipu)

38.4

Rank #175 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Claude 3.7 Sonnet scores higher in 6 categories and GLM-4.7-Flash in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in long context, where Claude 3.7 Sonnet leads 50.2 to 40.9.
  • The biggest single-benchmark swing is GPQA Diamond: 79.7% for Claude 3.7 Sonnet and 60.5% for GLM-4.7-Flash.
  • GLM-4.7-Flash has downloadable open weights; the other is API-only.

Side by side

Claude 3.7 SonnetGLM-4.7-Flash
ProviderAnthropicZ.ai (Zhipu)
Noometry Index39.438.4
Released2025-02-242026-01-19
WeightsProprietaryOpen
Context window—200K
Max output—131K
Input $ / M tokens—$0.06
Output $ / M tokens—$0.40
Results tracked5821

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 41.1 (#120), GLM-4.7-Flash: 40.0 (#133)

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
LMArena Coding13611383
SWE-bench Verified61%—
SWE-bench Verified (bash only)52.8%—
Aider Polyglot64.9%—
GSO3.8%—
LiveBench Coding74.5%—
CadEval54%—

Agentic & Tool Use Not comparable

Claude 3.7 Sonnet: 33.9 (#46), GLM-4.7-Flash: —

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
TheAgentCompany30.9%—
Cybench20%—
DeepResearch Bench43.6%—
OSWorld35.8%—
METR Time Horizons60%—

Reasoning GLM-4.7-Flash leads

Claude 3.7 Sonnet: 18.7 (#252), GLM-4.7-Flash: 20.2 (#224)

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
LMArena Hard Prompts13331356
ARC-AGI-20.9%—
SimpleBench46.4%—
ARC-AGI-128.6%—
Chess Puzzles—0%
EnigmaEval4.2%—
LiveBench Reasoning87.8%—
LiveBench Data Analysis74%—
Epoch Capabilities Index141.16—
ForecastBench61.8—
LiveBench76.1%—

Math Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 35.7 (#137), GLM-4.7-Flash: 34.4 (#159)

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
OTIS Mock AIME 2024-202557.8%58.3%
LMArena Math13361354
Omni-MATH33%—
LiveBench Math79%—
MATH Level 591.2%—
FrontierMath (Feb 2025 set)4.1%—

Knowledge Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 39.7 (#117), GLM-4.7-Flash: 35.4 (#177)

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
GPQA Diamond79.7%60.5%
LMArena Expert13211357
Humanity's Last Exam8%—
MMLU-Pro78.4%—
Confabulations14.7%—
Vectara Hallucination Rate—9.3%
GPQA (HELM)60.8%—

Multimodal Not comparable

Claude 3.7 Sonnet: 33.1 (#90), GLM-4.7-Flash: —

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
LMArena Vision1169—
GeoBench68%—
VPCT39%—
SpatialViz-Bench33.9%—

Multilingual GLM-4.7-Flash leads

Claude 3.7 Sonnet: 44.3 (#174), GLM-4.7-Flash: 46.8 (#152)

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
LMArena Non-English12961331
LMArena Chinese12991403
LMArena French13021332
LMArena German13011336
LMArena Korean12491284
LMArena Russian13111333
LMArena Spanish12991351
LMArena Japanese1268—

Instruction Following Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 73.1 (#120), GLM-4.7-Flash: 70.3 (#162)

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
LMArena Instruction Following13521327
LiveBench Instruction Following81.3%—
IFEval83.4%—

Long Context Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 50.2 (#10), GLM-4.7-Flash: 40.9 (#143)

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
LMArena Longer Query13731345
Fiction.LiveBench83.3%—

Writing & Preference Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 54.6 (#145), GLM-4.7-Flash: 47.7 (#206)

BenchmarkClaude 3.7 SonnetGLM-4.7-Flash
LMArena Text13141351
LMArena Creative Writing13321297
EQ-Bench Creative Writing14121125
LMArena Multi-Turn13391342
Short-Story Creative Writing81.1%—
WildBench81.4%—
LiveBench Language59.9%—

Frequently asked questions

Is Claude 3.7 Sonnet better than GLM-4.7-Flash?

Claude 3.7 Sonnet and GLM-4.7-Flash score almost the same on the Noometry Index (39.4 vs 38.4), so choose on price, context window or the category you care about most.

Is Claude 3.7 Sonnet or GLM-4.7-Flash better for coding?

Claude 3.7 Sonnet scores higher on coding benchmarks: 41.1 versus 40.0 in the Noometry coding category.

How many benchmarks do Claude 3.7 Sonnet and GLM-4.7-Flash share?

19 benchmarks have published results for both models. Claude 3.7 Sonnet has 58 scored results on Noometry and GLM-4.7-Flash has 21.

Related comparisons

Go deeper