Model comparison

Claude 3.5 Sonnet vs GLM-5V-Turbo

GLM-5V-Turbo is the stronger model overall, scoring 43.1 to 34.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Claude 3.5 Sonnet Anthropic

34.4

Rank #225 Confirmed

GLM-5V-Turbo Z.ai (Zhipu)

43.1

Rank #86 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Claude 3.5 Sonnet scores higher in 0 categories and GLM-5V-Turbo in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-5V-Turbo leads 36.6 to 18.0.

Side by side

Claude 3.5 Sonnet and GLM-5V-Turbo specifications
Claude 3.5 SonnetGLM-5V-Turbo
ProviderAnthropicZ.ai (Zhipu)
Noometry Index34.443.1
Released2024-06-202026-04-01
WeightsProprietaryProprietary
Context window—200K
Max output—131K
Input $ / M tokens—$1.20
Output $ / M tokens—$4
Results tracked6019

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5V-Turbo leads

Claude 3.5 Sonnet: 39.5 (#145), GLM-5V-Turbo: 41.8 (#105)

Coding benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
LMArena Coding13431467
Aider Polyglot51.6%—
LMArena WebDev—1400
GSO4.6%—
WeirdML40%—
BigCodeBench Instruct46.8%—
LiveBench Coding67.1%—
BigCodeBench Complete58.6%—
CadEval48%—
HumanEval+81.7%—
MBPP+74.3%—

Agentic & Tool Use Not comparable

Claude 3.5 Sonnet: 32.1 (#61), GLM-5V-Turbo: —

Agentic & Tool Use benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
TheAgentCompany24%—
Cybench17.5%—
BALROG32.6%—
METR Time Horizons45.2%—

Reasoning GLM-5V-Turbo leads

Claude 3.5 Sonnet: 22.5 (#176), GLM-5V-Turbo: 28.5 (#87)

Reasoning benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
LMArena Hard Prompts13051443
SimpleBench41.4%—
EnigmaEval0.9%—
LiveBench Reasoning56.7%—
DTBench67.8%—
LiveBench Data Analysis55%—
Epoch Capabilities Index133.55—
ForecastBench60.7—
LiveBench59%—

Math GLM-5V-Turbo leads

Claude 3.5 Sonnet: 18.0 (#282), GLM-5V-Turbo: 36.6 (#109)

Math benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
LMArena Math13061440
OTIS Mock AIME 2024-20258.5%—
Omni-MATH27.6%—
LiveBench Math52.3%—
MATH Level 556.9%—
FrontierMath (Feb 2025 set)2.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge GLM-5V-Turbo leads

Claude 3.5 Sonnet: 28.5 (#236), GLM-5V-Turbo: 39.9 (#113)

Knowledge benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
LMArena Expert12641451
GPQA Diamond55.3%—
Humanity's Last Exam4.1%—
MMLU-Pro77.7%—
Confabulations19.9%—
GPQA (HELM)56.5%—
MMLU87.3%—

Multimodal GLM-5V-Turbo leads

Claude 3.5 Sonnet: 26.0 (#115), GLM-5V-Turbo: 40.1 (#41)

Multimodal benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
LMArena Vision11251264
Video-MME60%—
GeoBench62%—
VPCT33%—
LMArena Document—1416

Multilingual GLM-5V-Turbo leads

Claude 3.5 Sonnet: 43.4 (#180), GLM-5V-Turbo: 53.2 (#69)

Multilingual benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
LMArena Non-English12831420
LMArena Chinese12711488
LMArena French13041443
LMArena German12971422
LMArena Korean12001399
LMArena Russian13051432
LMArena Spanish12891446
LMArena Japanese1234—

Instruction Following GLM-5V-Turbo leads

Claude 3.5 Sonnet: 69.0 (#177), GLM-5V-Turbo: 75.1 (#75)

Instruction Following benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
LMArena Instruction Following12971422
LiveBench Instruction Following69.3%—
IFEval85.5%—

Long Context GLM-5V-Turbo leads

Claude 3.5 Sonnet: 39.9 (#162), GLM-5V-Turbo: 44.0 (#76)

Long Context benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
LMArena Longer Query13111439

Writing & Preference GLM-5V-Turbo leads

Claude 3.5 Sonnet: 53.0 (#159), GLM-5V-Turbo: 62.6 (#69)

Writing & Preference benchmarks
BenchmarkClaude 3.5 SonnetGLM-5V-Turbo
LMArena Text12981437
LMArena Creative Writing12921414
LMArena Multi-Turn13261432
Short-Story Creative Writing80.3%—
EQ-Bench Creative Writing1451—
WildBench79.2%—
LiveBench Language53.8%—

Frequently asked questions

Is Claude 3.5 Sonnet better than GLM-5V-Turbo?

GLM-5V-Turbo is the stronger model overall, scoring 43.1 to 34.4 on the Noometry Index.

Is Claude 3.5 Sonnet or GLM-5V-Turbo better for coding?

GLM-5V-Turbo scores higher on coding benchmarks: 41.8 versus 39.5 in the Noometry coding category.

How many benchmarks do Claude 3.5 Sonnet and GLM-5V-Turbo share?

17 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and GLM-5V-Turbo has 19.

Related comparisons

Go deeper