Noometry

Model comparison

Gemini 2.5 Flash vs GLM-4.6

GLM-4.6 is the stronger model overall, scoring 41.4 to 39.3 on the Noometry Index.

Last verified . 27 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

GLM-4.6 Z.ai (Zhipu)

41.4

Rank #135 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 3 categories and GLM-4.6 in 6 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-4.6 leads 61.1 to 53.8.
  • The biggest single-benchmark swing is SWE-bench Verified (bash only): 28.7% for Gemini 2.5 Flash and 55.4% for GLM-4.6.
  • Gemini 2.5 Flash is cheaper at $0.30 / $2.50 per million input/output tokens, against $0.60 / $2.20 for GLM-4.6.
  • Gemini 2.5 Flash accepts more context: 1.05M tokens versus 205K.
  • GLM-4.6 has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 FlashGLM-4.6
ProviderGoogleZ.ai (Zhipu)
Noometry Index39.341.4
Released2025-04-172025-09-30
WeightsProprietaryOpen
Context window1.05M205K
Max output66K131K
Input $ / M tokens$0.30$0.60
Output $ / M tokens$2.50$2.20
Results tracked5429

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6 leads

Gemini 2.5 Flash: 35.8 (#220), GLM-4.6: 40.1 (#148)

BenchmarkGemini 2.5 FlashGLM-4.6
SWE-bench Verified (bash only)28.7%55.4%
LMArena Coding14241449
ALE-Bench661.88340.82
Aider Polyglot55.1%—
LMArena WebDev—1340
SciCode—38.4%
WeirdML41.9%—

Agentic & Tool Use GLM-4.6 leads

Gemini 2.5 Flash: 30.8 (#74), GLM-4.6: 32.3 (#66)

BenchmarkGemini 2.5 FlashGLM-4.6
Terminal-Bench17.1%24.5%
Berkeley Function Calling Leaderboard56.2%72.4%
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning GLM-4.6 leads

Gemini 2.5 Flash: 18.1 (#286), GLM-4.6: 23.7 (#172)

BenchmarkGemini 2.5 FlashGLM-4.6
Kagi LLM Benchmark56.8%47.4%
CritPt1.1%1.1%
LMArena Hard Prompts14221440
ARC-AGI-22.5%—
SimpleBench41.2%—
ARC-AGI-133.3%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.03—
ForecastBench60.6—

Math Too close to call

Gemini 2.5 Flash: 39.9 (#98), GLM-4.6: 39.1 (#111)

BenchmarkGemini 2.5 FlashGLM-4.6
LMArena Math14151432
FrontierMath (Feb 2025 set)4.8%3.8%
FrontierMath Tier 4 (v1)4.2%2.1%
OTIS Mock AIME 2024-202573.1%—
Omni-MATH38.5%—

Knowledge GLM-4.6 leads

Gemini 2.5 Flash: 36.4 (#168), GLM-4.6: 40.2 (#124)

BenchmarkGemini 2.5 FlashGLM-4.6
Vectara Hallucination Rate7.8%9.5%
LMArena Expert14261431
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
GPQA (HELM)39%—

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), GLM-4.6: —

BenchmarkGemini 2.5 FlashGLM-4.6
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual GLM-4.6 leads

Gemini 2.5 Flash: 52.3 (#88), GLM-4.6: 53.5 (#66)

BenchmarkGemini 2.5 FlashGLM-4.6
LMArena Non-English14091426
LMArena Chinese14501499
LMArena French14331459
LMArena German14181447
LMArena Japanese14051393
LMArena Korean13851400
LMArena Russian14151419
LMArena Spanish14211436

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.7 (#54), GLM-4.6: 74.3 (#98)

BenchmarkGemini 2.5 FlashGLM-4.6
LMArena Instruction Following14051410
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), GLM-4.6: 43.4 (#94)

BenchmarkGemini 2.5 FlashGLM-4.6
LMArena Longer Query14191422
Fiction.LiveBench77.8%—

Writing & Preference GLM-4.6 leads

Gemini 2.5 Flash: 53.8 (#157), GLM-4.6: 61.1 (#90)

BenchmarkGemini 2.5 FlashGLM-4.6
LMArena Text14171440
LMArena Creative Writing14001411
EQ-Bench Creative Writing11371411
LMArena Multi-Turn14081427
Short-Story Creative Writing76.5%—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than GLM-4.6?

GLM-4.6 is the stronger model overall, scoring 41.4 to 39.3 on the Noometry Index.

Which is cheaper, Gemini 2.5 Flash or GLM-4.6?

Gemini 2.5 Flash is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; GLM-4.6 lists at $0.60 and $2.20.

Is Gemini 2.5 Flash or GLM-4.6 better for coding?

GLM-4.6 scores higher on coding benchmarks: 40.1 versus 35.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash does, with 1.05M tokens against 205K.

How many benchmarks do Gemini 2.5 Flash and GLM-4.6 share?

27 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and GLM-4.6 has 29.

Related comparisons

Go deeper