Model comparison

Gemini 2.5 Flash vs GLM-5

GLM-5 is the stronger model overall, scoring 46.1 to 39.3 on the Noometry Index. Gemini 2.5 Flash costs 1.8× less per token, which makes it the better buy when GLM-5's lead doesn't matter for your workload.

Last verified . 33 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

GLM-5 Z.ai (Zhipu)

46.1

Rank #66 Confirmed

Summary

  • They share 33 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 2 categories and GLM-5 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-5 leads 52.3 to 36.4.
  • The biggest single-benchmark swing is SWE-bench Verified (bash only): 28.7% for Gemini 2.5 Flash and 72.8% for GLM-5.
  • Gemini 2.5 Flash is cheaper at $0.30 / $2.50 per million input/output tokens, against $1 / $3.20 for GLM-5.
  • Gemini 2.5 Flash accepts more context: 1.05M tokens versus 205K.
  • GLM-5 has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash and GLM-5 specifications
Gemini 2.5 FlashGLM-5
ProviderGoogleZ.ai (Zhipu)
Noometry Index39.346.1
Released2025-04-172026-02-11
WeightsProprietaryOpen
Context window1.05M205K
Max output66K131K
Input $ / M tokens$0.30$1
Output $ / M tokens$2.50$3.20
Results tracked5445

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5 leads

Gemini 2.5 Flash: 35.8 (#220), GLM-5: 49.0 (#52)

Coding benchmarks
BenchmarkGemini 2.5 FlashGLM-5
SWE-bench Verified (bash only)28.7%72.8%
WeirdML41.9%48.2%
LMArena Coding14241461
ALE-Bench661.88765.62
SWE-bench Verified—72.1%
Aider Polyglot55.1%—
LMArena WebDev—1434
SWE-bench Multilingual—69.7%

Agentic & Tool Use Too close to call

Gemini 2.5 Flash: 30.8 (#74), GLM-5: 31.1 (#71)

Agentic & Tool Use benchmarks
BenchmarkGemini 2.5 FlashGLM-5
Terminal-Bench17.1%52.4%
Vending-Bench 2548.844,432
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
τ²-bench Airline—82.5%
τ²-bench Banking—9.8%
τ²-bench Retail—73.7%
τ²-bench Telecom—86.8%
BALROG33.5%—

Reasoning GLM-5 leads

Gemini 2.5 Flash: 18.1 (#286), GLM-5: 27.6 (#116)

Reasoning benchmarks
BenchmarkGemini 2.5 FlashGLM-5
ARC-AGI-22.5%4.9%
SimpleBench41.2%53.2%
Kagi LLM Benchmark56.8%75%
ARC-AGI-133.3%44.7%
LMArena Hard Prompts14221452
Epoch Capabilities Index143.03145.83
ForecastBench60.661
NYT Connections (extended)—74.8%
CritPt1.1%—
Chess Puzzles—10%
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—

Math GLM-5 leads

Gemini 2.5 Flash: 39.9 (#98), GLM-5: 46.4 (#71)

Math benchmarks
BenchmarkGemini 2.5 FlashGLM-5
OTIS Mock AIME 2024-202573.1%80%
LMArena Math14151440
FrontierMath (Feb 2025 set)4.8%16.4%
FrontierMath Tier 4 (v1)4.2%2.1%
MathArena Final-Answer Competitions—65.7%
Omni-MATH38.5%—

Knowledge GLM-5 leads

Gemini 2.5 Flash: 36.4 (#168), GLM-5: 52.3 (#64)

Knowledge benchmarks
BenchmarkGemini 2.5 FlashGLM-5
Vectara Hallucination Rate7.8%10.1%
LMArena Expert14261454
GPQA Diamond—87.8%
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
GPQA (HELM)39%—

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), GLM-5: —

Multimodal benchmarks
BenchmarkGemini 2.5 FlashGLM-5
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual GLM-5 leads

Gemini 2.5 Flash: 52.3 (#88), GLM-5: 53.7 (#58)

Multilingual benchmarks
BenchmarkGemini 2.5 FlashGLM-5
LMArena Non-English14091430
LMArena Chinese14501511
LMArena French14331455
LMArena German14181445
LMArena Japanese14051416
LMArena Korean13851423
LMArena Russian14151436
LMArena Spanish14211454

Instruction Following Too close to call

Gemini 2.5 Flash: 75.7 (#54), GLM-5: 75.2 (#67)

Instruction Following benchmarks
BenchmarkGemini 2.5 FlashGLM-5
LMArena Instruction Following14051428
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), GLM-5: 44.7 (#60)

Long Context benchmarks
BenchmarkGemini 2.5 FlashGLM-5
LMArena Longer Query14191446
Fiction.LiveBench77.8%—
CL-bench—18.7%

Writing & Preference GLM-5 leads

Gemini 2.5 Flash: 53.8 (#157), GLM-5: 66.0 (#38)

Writing & Preference benchmarks
BenchmarkGemini 2.5 FlashGLM-5
LMArena Text14171446
LMArena Creative Writing14001439
EQ-Bench Creative Writing11371601
LMArena Multi-Turn14081456
Short-Story Creative Writing76.5%—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than GLM-5?

GLM-5 is the stronger model overall, scoring 46.1 to 39.3 on the Noometry Index. Gemini 2.5 Flash costs 1.8× less per token, which makes it the better buy when GLM-5's lead doesn't matter for your workload.

Which is cheaper, Gemini 2.5 Flash or GLM-5?

Gemini 2.5 Flash is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; GLM-5 lists at $1 and $3.20.

Is Gemini 2.5 Flash or GLM-5 better for coding?

GLM-5 scores higher on coding benchmarks: 49.0 versus 35.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash does, with 1.05M tokens against 205K.

How many benchmarks do Gemini 2.5 Flash and GLM-5 share?

33 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and GLM-5 has 45.

Related comparisons

Go deeper