Noometry

Model comparison

Claude 3 Sonnet vs GLM-4.6

GLM-4.6 is the stronger model overall, scoring 41.4 to 29.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

Claude 3 Sonnet Anthropic

29.0

Rank #319 Confirmed

GLM-4.6 Z.ai (Zhipu)

41.4

Rank #135 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Claude 3 Sonnet scores higher in 0 categories and GLM-4.6 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-4.6 leads 39.1 to 10.7.
  • GLM-4.6 has downloadable open weights; the other is API-only.

Side by side

Claude 3 SonnetGLM-4.6
ProviderAnthropicZ.ai (Zhipu)
Noometry Index29.041.4
Released2024-02-292025-09-30
WeightsProprietaryOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.60
Output $ / M tokens—$2.20
Results tracked3029

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6 leads

Claude 3 Sonnet: 29.6 (#302), GLM-4.6: 40.1 (#148)

BenchmarkClaude 3 SonnetGLM-4.6
LMArena Coding12231449
SWE-bench Verified (bash only)—55.4%
LMArena WebDev—1340
SciCode—38.4%
WeirdML10.2%—
BigCodeBench Instruct42.7%—
BigCodeBench Complete53.8%—
ALE-Bench—340.82
HumanEval+64%—
MBPP+69.3%—

Agentic & Tool Use Not comparable

Claude 3 Sonnet: —, GLM-4.6: 32.3 (#66)

BenchmarkClaude 3 SonnetGLM-4.6
Terminal-Bench—24.5%
Berkeley Function Calling Leaderboard—72.4%

Reasoning GLM-4.6 leads

Claude 3 Sonnet: 20.5 (#237), GLM-4.6: 23.7 (#172)

BenchmarkClaude 3 SonnetGLM-4.6
LMArena Hard Prompts11971440
Kagi LLM Benchmark—47.4%
CritPt—1.1%
DTBench53.6%—
Epoch Capabilities Index120.7—
WinoGrande75.1%—

Math GLM-4.6 leads

Claude 3 Sonnet: 10.7 (#310), GLM-4.6: 39.1 (#111)

BenchmarkClaude 3 SonnetGLM-4.6
LMArena Math12131432
OTIS Mock AIME 2024-20252.5%—
MATH Level 518.2%—
FrontierMath (Feb 2025 set)—3.8%
FrontierMath Tier 4 (v1)—2.1%

Knowledge GLM-4.6 leads

Claude 3 Sonnet: 21.1 (#276), GLM-4.6: 40.2 (#124)

BenchmarkClaude 3 SonnetGLM-4.6
LMArena Expert11731431
GPQA Diamond40.6%—
Vectara Hallucination Rate—9.5%
MMLU75.9%—

Multimodal Not comparable

Claude 3 Sonnet: 25.2 (#125), GLM-4.6: —

BenchmarkClaude 3 SonnetGLM-4.6
LMArena Vision984—

Multilingual GLM-4.6 leads

Claude 3 Sonnet: 37.8 (#234), GLM-4.6: 53.5 (#66)

BenchmarkClaude 3 SonnetGLM-4.6
LMArena Non-English12051426
LMArena Chinese11891499
LMArena French12291459
LMArena German12041447
LMArena Japanese11311393
LMArena Korean11281400
LMArena Russian12271419
LMArena Spanish12041436

Instruction Following GLM-4.6 leads

Claude 3 Sonnet: 62.8 (#235), GLM-4.6: 74.3 (#98)

BenchmarkClaude 3 SonnetGLM-4.6
LMArena Instruction Following11991410

Long Context GLM-4.6 leads

Claude 3 Sonnet: 36.7 (#228), GLM-4.6: 43.4 (#94)

BenchmarkClaude 3 SonnetGLM-4.6
LMArena Longer Query12111422

Writing & Preference GLM-4.6 leads

Claude 3 Sonnet: 42.1 (#238), GLM-4.6: 61.1 (#90)

BenchmarkClaude 3 SonnetGLM-4.6
LMArena Text12181440
LMArena Creative Writing11861411
LMArena Multi-Turn12271427
EQ-Bench Creative Writing—1411

Frequently asked questions

Is Claude 3 Sonnet better than GLM-4.6?

GLM-4.6 is the stronger model overall, scoring 41.4 to 29.0 on the Noometry Index.

Is Claude 3 Sonnet or GLM-4.6 better for coding?

GLM-4.6 scores higher on coding benchmarks: 40.1 versus 29.6 in the Noometry coding category.

How many benchmarks do Claude 3 Sonnet and GLM-4.6 share?

17 benchmarks have published results for both models. Claude 3 Sonnet has 30 scored results on Noometry and GLM-4.6 has 29.

Related comparisons

Go deeper