Model comparison

Falcon-180B vs GLM-5V-Turbo

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 32.2 on the Noometry Index.

Last verified . 6 shared benchmarks.

GLM-5V-Turbo Z.ai (Zhipu)

43.8

Rank #84 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and GLM-5V-Turbo in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-5V-Turbo leads 62.5 to 29.1.
  • Falcon-180B has downloadable open weights; the other is API-only.

Side by side

Falcon-180B and GLM-5V-Turbo specifications
Falcon-180BGLM-5V-Turbo
ProviderTechnology Innovation InstituteZ.ai (Zhipu)
Noometry Index32.243.8
Released2023-09-062026-04-01
WeightsOpenProprietary
Context window—200K
Max output—131K
Input $ / M tokens—$1.20
Output $ / M tokens—$4
Results tracked1619

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, GLM-5V-Turbo: 42.1 (#111)

Coding benchmarks
BenchmarkFalcon-180BGLM-5V-Turbo
LMArena WebDev—1401
LMArena Coding—1466

Reasoning GLM-5V-Turbo leads

Falcon-180B: 19.1 (#269), GLM-5V-Turbo: 29.7 (#89)

Reasoning benchmarks
BenchmarkFalcon-180BGLM-5V-Turbo
LMArena Hard Prompts10071443
Epoch Capabilities Index112.13—
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, GLM-5V-Turbo: 39.4 (#106)

Math benchmarks
BenchmarkFalcon-180BGLM-5V-Turbo
LMArena Math—1441
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, GLM-5V-Turbo: 40.6 (#117)

Knowledge benchmarks
BenchmarkFalcon-180BGLM-5V-Turbo
LMArena Expert—1452
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multimodal Not comparable

Falcon-180B: —, GLM-5V-Turbo: 40.9 (#42)

Multimodal benchmarks
BenchmarkFalcon-180BGLM-5V-Turbo
LMArena Vision—1264
LMArena Document—1416

Multilingual GLM-5V-Turbo leads

Falcon-180B: 25.2 (#286), GLM-5V-Turbo: 53.0 (#73)

Multilingual benchmarks
BenchmarkFalcon-180BGLM-5V-Turbo
LMArena Non-English10001420
LMArena Chinese—1488
LMArena French—1444
LMArena German—1423
LMArena Korean—1396
LMArena Russian—1431
LMArena Spanish—1450

Instruction Following GLM-5V-Turbo leads

Falcon-180B: 53.4 (#286), GLM-5V-Turbo: 75.0 (#80)

Instruction Following benchmarks
BenchmarkFalcon-180BGLM-5V-Turbo
LMArena Instruction Following10471423

Long Context Not comparable

Falcon-180B: —, GLM-5V-Turbo: 44.0 (#80)

Long Context benchmarks
BenchmarkFalcon-180BGLM-5V-Turbo
LMArena Longer Query—1438

Writing & Preference GLM-5V-Turbo leads

Falcon-180B: 29.1 (#295), GLM-5V-Turbo: 62.5 (#73)

Writing & Preference benchmarks
BenchmarkFalcon-180BGLM-5V-Turbo
LMArena Text10541437
LMArena Creative Writing10891416
LMArena Multi-Turn10131432

Frequently asked questions

Is Falcon-180B better than GLM-5V-Turbo?

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and GLM-5V-Turbo share?

6 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and GLM-5V-Turbo has 19.

Related comparisons

Go deeper