Model comparison

Gemma 3 27B vs GLM-5V-Turbo

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 30.8 on the Noometry Index. Gemma 3 27B costs 19× less per token, which makes it the better buy when GLM-5V-Turbo's lead doesn't matter for your workload.

Last verified . 17 shared benchmarks.

Gemma 3 27B Google

30.8

Rank #284 Confirmed

GLM-5V-Turbo Z.ai (Zhipu)

43.8

Rank #84 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemma 3 27B scores higher in 0 categories and GLM-5V-Turbo in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in coding, where GLM-5V-Turbo leads 42.1 to 22.5.
  • Gemma 3 27B is cheaper at $0.08 / $0.16 per million input/output tokens, against $1.20 / $4 for GLM-5V-Turbo.
  • GLM-5V-Turbo accepts more context: 200K tokens versus 131K.
  • Gemma 3 27B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 27B and GLM-5V-Turbo specifications
Gemma 3 27BGLM-5V-Turbo
ProviderGoogleZ.ai (Zhipu)
Noometry Index30.843.8
Released2025-03-112026-04-01
WeightsOpenProprietary
Context window131K200K
Max output8K131K
Input $ / M tokens$0.08$1.20
Output $ / M tokens$0.16$4
Results tracked4319

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5V-Turbo leads

Gemma 3 27B: 22.5 (#334), GLM-5V-Turbo: 42.1 (#111)

Coding benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
LMArena Coding13221466
Aider Polyglot4.9%—
LMArena WebDev—1401
SciCode21.2%—
LiveBench Coding39.9%—

Agentic & Tool Use Not comparable

Gemma 3 27B: 25.1 (#110), GLM-5V-Turbo: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
Berkeley Function Calling Leaderboard29.5%—

Reasoning GLM-5V-Turbo leads

Gemma 3 27B: 16.7 (#301), GLM-5V-Turbo: 29.7 (#89)

Reasoning benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
LMArena Hard Prompts13401443
Kagi LLM Benchmark40.4%—
CritPt0%—
Chess Puzzles0%—
LiveBench Reasoning43.8%—
DTBench52.5%—
LiveBench Data Analysis51.5%—
LMCA12.3%—
Epoch Capabilities Index130.04—
LiveBench50%—

Math GLM-5V-Turbo leads

Gemma 3 27B: 25.9 (#265), GLM-5V-Turbo: 39.4 (#106)

Math benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
LMArena Math13121441
OTIS Mock AIME 2024-202522.5%—
LiveBench Math55.4%—
MATH Level 574%—

Knowledge GLM-5V-Turbo leads

Gemma 3 27B: 25.5 (#261), GLM-5V-Turbo: 40.6 (#117)

Knowledge benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
LMArena Expert13041452
GPQA Diamond47.7%—
Confabulations40.3%—
Vectara Hallucination Rate7.4%—

Multimodal GLM-5V-Turbo leads

Gemma 3 27B: 32.6 (#100), GLM-5V-Turbo: 40.9 (#42)

Multimodal benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
LMArena Vision11641264
GeoBench52%—
LMArena Document—1416

Multilingual GLM-5V-Turbo leads

Gemma 3 27B: 46.9 (#155), GLM-5V-Turbo: 53.0 (#73)

Multilingual benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
LMArena Non-English13341420
LMArena Chinese13461488
LMArena French13681444
LMArena German13621423
LMArena Korean13081396
LMArena Russian13491431
LMArena Spanish13491450
LMArena Japanese1287—

Instruction Following GLM-5V-Turbo leads

Gemma 3 27B: 70.6 (#160), GLM-5V-Turbo: 75.0 (#80)

Instruction Following benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
LMArena Instruction Following13211423
LiveBench Instruction Following74.9%—

Long Context GLM-5V-Turbo leads

Gemma 3 27B: 27.6 (#293), GLM-5V-Turbo: 44.0 (#80)

Long Context benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
LMArena Longer Query13331438
Fiction.LiveBench33.3%—

Writing & Preference GLM-5V-Turbo leads

Gemma 3 27B: 52.5 (#168), GLM-5V-Turbo: 62.5 (#73)

Writing & Preference benchmarks
BenchmarkGemma 3 27BGLM-5V-Turbo
LMArena Text13581437
LMArena Creative Writing13461416
LMArena Multi-Turn13451432
Short-Story Creative Writing79.9%—
EQ-Bench Creative Writing1266—
LiveBench Language34.6%—

Frequently asked questions

Is Gemma 3 27B better than GLM-5V-Turbo?

GLM-5V-Turbo is the stronger model overall, scoring 43.8 to 30.8 on the Noometry Index. Gemma 3 27B costs 19× less per token, which makes it the better buy when GLM-5V-Turbo's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 27B or GLM-5V-Turbo?

Gemma 3 27B is cheaper. It lists at $0.08 per million input tokens and $0.16 per million output tokens; GLM-5V-Turbo lists at $1.20 and $4.

Is Gemma 3 27B or GLM-5V-Turbo better for coding?

GLM-5V-Turbo scores higher on coding benchmarks: 42.1 versus 22.5 in the Noometry coding category.

Which has the bigger context window?

GLM-5V-Turbo does, with 200K tokens against 131K.

How many benchmarks do Gemma 3 27B and GLM-5V-Turbo share?

17 benchmarks have published results for both models. Gemma 3 27B has 43 scored results on Noometry and GLM-5V-Turbo has 19.

Related comparisons

Go deeper