Model comparison

Gemma 2B vs GLM-5V-Turbo

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 29.6 on the Noometry Index.

Last verified . 11 shared benchmarks.

Gemma 2B Google

29.6

Rank #307 Confirmed

GLM-5V-Turbo Z.ai (Zhipu)

43.8

Rank #84 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Gemma 2B scores higher in 0 categories and GLM-5V-Turbo in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-5V-Turbo leads 62.5 to 24.0.
  • Gemma 2B has downloadable open weights; the other is API-only.

Side by side

Gemma 2B and GLM-5V-Turbo specifications
Gemma 2BGLM-5V-Turbo
ProviderGoogleZ.ai (Zhipu)
Noometry Index29.643.8
Released2024-02-212026-04-01
WeightsOpenProprietary
Context window—200K
Max output—131K
Input $ / M tokens—$1.20
Output $ / M tokens—$4
Results tracked2319

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5V-Turbo leads

Gemma 2B: 29.4 (#305), GLM-5V-Turbo: 42.1 (#111)

Coding benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Coding10101466
LMArena WebDev—1401
HumanEval+20.7%—
MBPP+34.1%—

Reasoning GLM-5V-Turbo leads

Gemma 2B: 18.8 (#275), GLM-5V-Turbo: 29.7 (#89)

Reasoning benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Hard Prompts9891443
BIG-Bench Hard35.2%—
Epoch Capabilities Index94.2—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math GLM-5V-Turbo leads

Gemma 2B: 30.0 (#239), GLM-5V-Turbo: 39.4 (#106)

Math benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Math10091441
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, GLM-5V-Turbo: 40.6 (#117)

Knowledge benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Expert—1452
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multimodal Not comparable

Gemma 2B: —, GLM-5V-Turbo: 40.9 (#42)

Multimodal benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Vision—1264
LMArena Document—1416

Multilingual GLM-5V-Turbo leads

Gemma 2B: 23.0 (#294), GLM-5V-Turbo: 53.0 (#73)

Multilingual benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Non-English9581420
LMArena Chinese9861488
LMArena Russian9371431
LMArena French—1444
LMArena German—1423
LMArena Korean—1396
LMArena Spanish—1450

Instruction Following GLM-5V-Turbo leads

Gemma 2B: 48.5 (#302), GLM-5V-Turbo: 75.0 (#80)

Instruction Following benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Instruction Following9701423

Long Context GLM-5V-Turbo leads

Gemma 2B: 29.9 (#291), GLM-5V-Turbo: 44.0 (#80)

Long Context benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Longer Query9811438

Writing & Preference GLM-5V-Turbo leads

Gemma 2B: 24.0 (#308), GLM-5V-Turbo: 62.5 (#73)

Writing & Preference benchmarks
BenchmarkGemma 2BGLM-5V-Turbo
LMArena Text10021437
LMArena Creative Writing9871416
LMArena Multi-Turn9451432

Frequently asked questions

Is Gemma 2B better than GLM-5V-Turbo?

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 29.6 on the Noometry Index.

Is Gemma 2B or GLM-5V-Turbo better for coding?

GLM-5V-Turbo scores higher on coding benchmarks: 42.1 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2B and GLM-5V-Turbo share?

11 benchmarks have published results for both models. Gemma 2B has 23 scored results on Noometry and GLM-5V-Turbo has 19.

Related comparisons

Go deeper