Noometry

Model comparison

Gemini 2.0 Flash-Lite vs GLM-4.5-Air

GLM-4.5-Air is the stronger model overall, scoring 38.9 to 37.8 on the Noometry Index.

Last verified . 23 shared benchmarks.

Gemini 2.0 Flash-Lite Google

37.8

Rank #194 Confirmed

GLM-4.5-Air Z.ai (Zhipu)

38.9

Rank #177 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Gemini 2.0 Flash-Lite scores higher in 3 categories and GLM-4.5-Air in 5 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Gemini 2.0 Flash-Lite leads 37.9 to 33.3.
  • The biggest single-benchmark swing is GPQA (HELM): 50% for Gemini 2.0 Flash-Lite and 59.4% for GLM-4.5-Air.
  • GLM-4.5-Air has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 Flash-LiteGLM-4.5-Air
ProviderGoogleZ.ai (Zhipu)
Noometry Index37.838.9
Released2025-02-052025-07-20
WeightsProprietaryOpen
Context window—131K
Max output—98K
Input $ / M tokens—$0.20
Output $ / M tokens—$1.10
Results tracked3227

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 37.9 (#185), GLM-4.5-Air: 33.3 (#259)

BenchmarkGemini 2.0 Flash-LiteGLM-4.5-Air
LMArena Coding13221397
GSO—2.9%
LiveBench Coding47.1%—

Reasoning GLM-4.5-Air leads

Gemini 2.0 Flash-Lite: 22.0 (#210), GLM-4.5-Air: 24.1 (#166)

BenchmarkGemini 2.0 Flash-LiteGLM-4.5-Air
LMArena Hard Prompts13241379
ForecastBench57.159.2
Kagi LLM Benchmark—43%
LiveBench Reasoning50.1%—
DTBench52.5%—
LiveBench Data Analysis65.5%—
LiveBench54.3%—

Math GLM-4.5-Air leads

Gemini 2.0 Flash-Lite: 34.1 (#196), GLM-4.5-Air: 36.2 (#170)

BenchmarkGemini 2.0 Flash-LiteGLM-4.5-Air
Omni-MATH37.4%39.1%
LMArena Math13091396
LiveBench Math58.1%—

Knowledge Too close to call

Gemini 2.0 Flash-Lite: 35.0 (#189), GLM-4.5-Air: 35.0 (#191)

BenchmarkGemini 2.0 Flash-LiteGLM-4.5-Air
MMLU-Pro72%76.2%
GPQA (HELM)50%59.4%
LMArena Expert13051370
Humanity's Last Exam—8.1%
Vectara Hallucination Rate—9.3%

Multimodal Not comparable

Gemini 2.0 Flash-Lite: 31.2 (#109), GLM-4.5-Air: —

BenchmarkGemini 2.0 Flash-LiteGLM-4.5-Air
LMArena Vision1100—

Multilingual GLM-4.5-Air leads

Gemini 2.0 Flash-Lite: 46.0 (#161), GLM-4.5-Air: 49.1 (#135)

BenchmarkGemini 2.0 Flash-LiteGLM-4.5-Air
LMArena Non-English13231366
LMArena Chinese13391426
LMArena French13471399
LMArena German13061377
LMArena Japanese13011348
LMArena Korean13251308
LMArena Russian13281373
LMArena Spanish13131386

Instruction Following Too close to call

Gemini 2.0 Flash-Lite: 70.4 (#163), GLM-4.5-Air: 69.6 (#171)

BenchmarkGemini 2.0 Flash-LiteGLM-4.5-Air
IFEval82.4%81.2%
LMArena Instruction Following13051354
LiveBench Instruction Following78.3%—

Long Context GLM-4.5-Air leads

Gemini 2.0 Flash-Lite: 40.1 (#160), GLM-4.5-Air: 41.6 (#135)

BenchmarkGemini 2.0 Flash-LiteGLM-4.5-Air
LMArena Longer Query13201366

Writing & Preference GLM-4.5-Air leads

Gemini 2.0 Flash-Lite: 51.7 (#177), GLM-4.5-Air: 55.9 (#139)

BenchmarkGemini 2.0 Flash-LiteGLM-4.5-Air
LMArena Text13301384
LMArena Creative Writing13191343
WildBench79%78.9%
LMArena Multi-Turn13071371
LiveBench Language34.3%—

Frequently asked questions

Is Gemini 2.0 Flash-Lite better than GLM-4.5-Air?

GLM-4.5-Air is the stronger model overall, scoring 38.9 to 37.8 on the Noometry Index.

Is Gemini 2.0 Flash-Lite or GLM-4.5-Air better for coding?

Gemini 2.0 Flash-Lite scores higher on coding benchmarks: 37.9 versus 33.3 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Flash-Lite and GLM-4.5-Air share?

23 benchmarks have published results for both models. Gemini 2.0 Flash-Lite has 32 scored results on Noometry and GLM-4.5-Air has 27.

Related comparisons

Go deeper