Noometry

Model comparison

Gemini 3.1 Flash Lite vs GLM-4.5-Air

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.4 to 38.7 on the Noometry Index.

Last verified . 21 shared benchmarks.

Gemini 3.1 Flash Lite Google

40.4

Rank #141 Confirmed

GLM-4.5-Air Z.ai (Zhipu)

38.7

Rank #169 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 7 categories and GLM-4.5-Air in 1 category; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.1 Flash Lite leads 41.7 to 34.6.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 67.2% for Gemini 3.1 Flash Lite and 43% for GLM-4.5-Air.
  • GLM-4.5-Air is cheaper at $0.20 / $1.10 per million input/output tokens, against $0.25 / $1.50 for Gemini 3.1 Flash Lite.
  • Gemini 3.1 Flash Lite accepts more context: 1.05M tokens versus 131K.
  • GLM-4.5-Air has downloadable open weights; the other is API-only.

Side by side

Gemini 3.1 Flash LiteGLM-4.5-Air
ProviderGoogleZ.ai (Zhipu)
Noometry Index40.438.7
Released2026-03-032025-07-20
WeightsProprietaryOpen
Context window1.05M131K
Max output66K98K
Input $ / M tokens$0.25$0.20
Output $ / M tokens$1.50$1.10
Results tracked3827

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 37.5 (#179), GLM-4.5-Air: 34.5 (#225)

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
LMArena Coding14001397
LMArena WebDev1256—
SciCode41.9%—
GSO—2.9%
WeirdML52.2%—
ALE-Bench797.73—

Agentic & Tool Use Not comparable

Gemini 3.1 Flash Lite: 29.9 (#72), GLM-4.5-Air: —

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
DeepResearch Bench37.3%—

Reasoning Too close to call

Gemini 3.1 Flash Lite: 22.3 (#181), GLM-4.5-Air: 23.3 (#166)

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
Kagi LLM Benchmark67.2%43%
LMArena Hard Prompts14071379
ForecastBench54.459.2
NYT Connections (extended)8.2%—
CritPt1.1%—
Chess Puzzles25%—
EnigmaEval3%—
Thematic Generalization63.3%—
DTBench76.8%—
LMCA35%—
Epoch Capabilities Index144.45—

Math Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 39.5 (#82), GLM-4.5-Air: 33.8 (#166)

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
LMArena Math14271396
FrontierMath (Tiers 1-3)27.7%—
OTIS Mock AIME 2024-202580%—
Omni-MATH—39.1%

Knowledge Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 41.7 (#95), GLM-4.5-Air: 34.6 (#184)

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
Humanity's Last Exam8.6%8.1%
Vectara Hallucination Rate8.2%9.3%
LMArena Expert13971370
GPQA Diamond81.8%—
MMLU-Pro—76.2%
GPQA (HELM)—59.4%

Multimodal Not comparable

Gemini 3.1 Flash Lite: 38.7 (#57), GLM-4.5-Air: —

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
LMArena Vision1240—

Multilingual Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 52.5 (#82), GLM-4.5-Air: 49.4 (#130)

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
LMArena Non-English14101366
LMArena Chinese14611427
LMArena French14231399
LMArena German14291376
LMArena Japanese14111348
LMArena Korean13931306
LMArena Russian14201373
LMArena Spanish14201385

Instruction Following Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 72.9 (#126), GLM-4.5-Air: 69.8 (#165)

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
LMArena Instruction Following13761353
IFEval—81.2%

Long Context Too close to call

Gemini 3.1 Flash Lite: 42.5 (#117), GLM-4.5-Air: 41.6 (#130)

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
LMArena Longer Query13941367

Writing & Preference Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 61.0 (#90), GLM-4.5-Air: 56.1 (#134)

BenchmarkGemini 3.1 Flash LiteGLM-4.5-Air
LMArena Text14161384
LMArena Creative Writing14011343
LMArena Multi-Turn14171371
WildBench—78.9%

Frequently asked questions

Is Gemini 3.1 Flash Lite better than GLM-4.5-Air?

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.4 to 38.7 on the Noometry Index.

Which is cheaper, Gemini 3.1 Flash Lite or GLM-4.5-Air?

GLM-4.5-Air is cheaper. It lists at $0.20 per million input tokens and $1.10 per million output tokens; Gemini 3.1 Flash Lite lists at $0.25 and $1.50.

Is Gemini 3.1 Flash Lite or GLM-4.5-Air better for coding?

Gemini 3.1 Flash Lite scores higher on coding benchmarks: 37.5 versus 34.5 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.1 Flash Lite does, with 1.05M tokens against 131K.

How many benchmarks do Gemini 3.1 Flash Lite and GLM-4.5-Air share?

21 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and GLM-4.5-Air has 27.

Related comparisons

Go deeper