Model comparison

Claude 2 vs GLM-5V-Turbo

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 25.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2 Anthropic

25.0

Rank #346 Reported

GLM-5V-Turbo Z.ai (Zhipu)

43.8

Rank #84 Confirmed

Summary

  • The widest gap is in math, where GLM-5V-Turbo leads 39.4 to 9.3.

Side by side

Claude 2 and GLM-5V-Turbo specifications
Claude 2GLM-5V-Turbo
ProviderAnthropicZ.ai (Zhipu)
Noometry Index25.043.8
Released2023-07-112026-04-01
WeightsProprietaryProprietary
Context window—200K
Max output—131K
Input $ / M tokens—$1.20
Output $ / M tokens—$4
Results tracked819

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, GLM-5V-Turbo: 42.1 (#111)

Coding benchmarks
BenchmarkClaude 2GLM-5V-Turbo
LMArena WebDev—1401
LMArena Coding—1466
HumanEval+61.6%—

Reasoning GLM-5V-Turbo leads

Claude 2: 21.7 (#216), GLM-5V-Turbo: 29.7 (#89)

Reasoning benchmarks
BenchmarkClaude 2GLM-5V-Turbo
LMArena Hard Prompts—1443
DTBench51.9%—
Epoch Capabilities Index120.13—

Math GLM-5V-Turbo leads

Claude 2: 9.3 (#320), GLM-5V-Turbo: 39.4 (#106)

Math benchmarks
BenchmarkClaude 2GLM-5V-Turbo
OTIS Mock AIME 2024-20252.5%—
LMArena Math—1441
MATH Level 511.7%—

Knowledge GLM-5V-Turbo leads

Claude 2: 16.9 (#287), GLM-5V-Turbo: 40.6 (#117)

Knowledge benchmarks
BenchmarkClaude 2GLM-5V-Turbo
GPQA Diamond34.7%—
LMArena Expert—1452
MMLU78.5%—
TriviaQA87.5%—

Multimodal Not comparable

Claude 2: —, GLM-5V-Turbo: 40.9 (#42)

Multimodal benchmarks
BenchmarkClaude 2GLM-5V-Turbo
LMArena Vision—1264
LMArena Document—1416

Multilingual Not comparable

Claude 2: —, GLM-5V-Turbo: 53.0 (#73)

Multilingual benchmarks
BenchmarkClaude 2GLM-5V-Turbo
LMArena Non-English—1420
LMArena Chinese—1488
LMArena French—1444
LMArena German—1423
LMArena Korean—1396
LMArena Russian—1431
LMArena Spanish—1450

Instruction Following Not comparable

Claude 2: —, GLM-5V-Turbo: 75.0 (#80)

Instruction Following benchmarks
BenchmarkClaude 2GLM-5V-Turbo
LMArena Instruction Following—1423

Long Context Not comparable

Claude 2: —, GLM-5V-Turbo: 44.0 (#80)

Long Context benchmarks
BenchmarkClaude 2GLM-5V-Turbo
LMArena Longer Query—1438

Writing & Preference Not comparable

Claude 2: —, GLM-5V-Turbo: 62.5 (#73)

Writing & Preference benchmarks
BenchmarkClaude 2GLM-5V-Turbo
LMArena Text—1437
LMArena Creative Writing—1416
LMArena Multi-Turn—1432

Frequently asked questions

Is Claude 2 better than GLM-5V-Turbo?

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 25.0 on the Noometry Index.

How many benchmarks do Claude 2 and GLM-5V-Turbo share?

0 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and GLM-5V-Turbo has 19.

Related comparisons

Go deeper