Model comparison

Claude 2.1 vs GLM-5V-Turbo

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 25.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

GLM-5V-Turbo Z.ai (Zhipu)

43.8

Rank #84 Confirmed

Summary

  • The widest gap is in math, where GLM-5V-Turbo leads 39.4 to 10.2.

Side by side

Claude 2.1 and GLM-5V-Turbo specifications
Claude 2.1GLM-5V-Turbo
ProviderAnthropicZ.ai (Zhipu)
Noometry Index25.243.8
Released2023-11-212026-04-01
WeightsProprietaryProprietary
Context window—200K
Max output—131K
Input $ / M tokens—$1.20
Output $ / M tokens—$4
Results tracked719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5V-Turbo leads

Claude 2.1: 26.2 (#327), GLM-5V-Turbo: 42.1 (#111)

Coding benchmarks
BenchmarkClaude 2.1GLM-5V-Turbo
LMArena WebDev—1401
WeirdML7.1%—
LMArena Coding—1466

Reasoning GLM-5V-Turbo leads

Claude 2.1: 21.4 (#221), GLM-5V-Turbo: 29.7 (#89)

Reasoning benchmarks
BenchmarkClaude 2.1GLM-5V-Turbo
LMArena Hard Prompts—1443
DTBench51%—
Epoch Capabilities Index119.27—
ForecastBench54.2—

Math GLM-5V-Turbo leads

Claude 2.1: 10.2 (#315), GLM-5V-Turbo: 39.4 (#106)

Math benchmarks
BenchmarkClaude 2.1GLM-5V-Turbo
OTIS Mock AIME 2024-20251.9%—
LMArena Math—1441

Knowledge GLM-5V-Turbo leads

Claude 2.1: 15.4 (#292), GLM-5V-Turbo: 40.6 (#117)

Knowledge benchmarks
BenchmarkClaude 2.1GLM-5V-Turbo
GPQA Diamond33%—
LMArena Expert—1452
MMLU73.5%—

Multimodal Not comparable

Claude 2.1: —, GLM-5V-Turbo: 40.9 (#42)

Multimodal benchmarks
BenchmarkClaude 2.1GLM-5V-Turbo
LMArena Vision—1264
LMArena Document—1416

Multilingual Not comparable

Claude 2.1: —, GLM-5V-Turbo: 53.0 (#73)

Multilingual benchmarks
BenchmarkClaude 2.1GLM-5V-Turbo
LMArena Non-English—1420
LMArena Chinese—1488
LMArena French—1444
LMArena German—1423
LMArena Korean—1396
LMArena Russian—1431
LMArena Spanish—1450

Instruction Following Not comparable

Claude 2.1: —, GLM-5V-Turbo: 75.0 (#80)

Instruction Following benchmarks
BenchmarkClaude 2.1GLM-5V-Turbo
LMArena Instruction Following—1423

Long Context Not comparable

Claude 2.1: —, GLM-5V-Turbo: 44.0 (#80)

Long Context benchmarks
BenchmarkClaude 2.1GLM-5V-Turbo
LMArena Longer Query—1438

Writing & Preference Not comparable

Claude 2.1: —, GLM-5V-Turbo: 62.5 (#73)

Writing & Preference benchmarks
BenchmarkClaude 2.1GLM-5V-Turbo
LMArena Text—1437
LMArena Creative Writing—1416
LMArena Multi-Turn—1432

Frequently asked questions

Is Claude 2.1 better than GLM-5V-Turbo?

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 25.2 on the Noometry Index.

Is Claude 2.1 or GLM-5V-Turbo better for coding?

GLM-5V-Turbo scores higher on coding benchmarks: 42.1 versus 26.2 in the Noometry coding category.

How many benchmarks do Claude 2.1 and GLM-5V-Turbo share?

0 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and GLM-5V-Turbo has 19.

Related comparisons

Go deeper