Noometry

Model comparison

Gemini 3.5 Flash Lite vs GLM-5.1

GLM-5.1 is the stronger model overall, scoring 47.8 to 41.5 on the Noometry Index. Gemini 3.5 Flash Lite costs 2.5× less per token, which makes it the better buy when GLM-5.1's lead doesn't matter for your workload.

Last verified . 31 shared benchmarks.

Gemini 3.5 Flash Lite Google

41.5

Rank #133 Confirmed

GLM-5.1 Z.ai (Zhipu)

47.8

Rank #59 Confirmed

Summary

  • They share 31 benchmarks with published results for both. Gemini 3.5 Flash Lite scores higher in 1 category and GLM-5.1 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-5.1 leads 49.7 to 25.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 71.1% for Gemini 3.5 Flash Lite and 93.3% for GLM-5.1.
  • Gemini 3.5 Flash Lite is cheaper at $0.30 / $2.50 per million input/output tokens, against $1.40 / $4.40 for GLM-5.1.
  • Gemini 3.5 Flash Lite accepts more context: 1.05M tokens versus 200K.
  • GLM-5.1 has downloadable open weights; the other is API-only.

Side by side

Gemini 3.5 Flash LiteGLM-5.1
ProviderGoogleZ.ai (Zhipu)
Noometry Index41.547.8
Released2026-07-212026-04-07
WeightsProprietaryOpen
Context window1.05M200K
Max output66K131K
Input $ / M tokens$0.30$1.40
Output $ / M tokens$2.50$4.40
Results tracked3941

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.1 leads

Gemini 3.5 Flash Lite: 42.4 (#104), GLM-5.1: 48.7 (#55)

BenchmarkGemini 3.5 Flash LiteGLM-5.1
LMArena WebDev14401508
SciCode41.3%43.8%
WeirdML39%57.1%
LMArena Coding14531485
ALE-Bench765.27887.1
SWE-bench Verified—74.2%

Agentic & Tool Use Too close to call

Gemini 3.5 Flash Lite: 25.7 (#107), GLM-5.1: 24.9 (#113)

BenchmarkGemini 3.5 Flash LiteGLM-5.1
APEX-Agents29.3%40.9%
ExploitBench—18.1%
GBAEval—0%
GDP.pdf10%—
Vending-Bench 2—5,634

Reasoning GLM-5.1 leads

Gemini 3.5 Flash Lite: 27.8 (#114), GLM-5.1: 39.1 (#60)

BenchmarkGemini 3.5 Flash LiteGLM-5.1
NYT Connections (extended)60.4%77.7%
CritPt0%4.6%
Chess Puzzles22%19%
LMArena Hard Prompts14411472
Epoch Capabilities Index145.13149.84
ARC-AGI-210.3%—
SimpleBench—55.1%
ARC-AGI-153.5%—
Thematic Generalization—69.8%
Mystery Game Puzzles19%—
DTBench83.5%—
LMCA37.6%—

Math GLM-5.1 leads

Gemini 3.5 Flash Lite: 25.9 (#264), GLM-5.1: 49.7 (#60)

BenchmarkGemini 3.5 Flash LiteGLM-5.1
FrontierMath (Tiers 1-3)26%36.8%
OTIS Mock AIME 2024-202571.1%93.3%
ProofBench13%22.2%
LMArena Math14331473
FrontierMath Tier 40%—
MathArena Final-Answer Competitions—67.1%
FrontierMath (Feb 2025 set)—33.4%
FrontierMath Tier 4 (v1)—12.5%

Knowledge GLM-5.1 leads

Gemini 3.5 Flash Lite: 50.1 (#72), GLM-5.1: 54.9 (#50)

BenchmarkGemini 3.5 Flash LiteGLM-5.1
GPQA Diamond83.3%89.9%
LMArena Expert14351476
SimpleQA Verified—34%

Multimodal Not comparable

Gemini 3.5 Flash Lite: 41.1 (#40), GLM-5.1: —

BenchmarkGemini 3.5 Flash LiteGLM-5.1
LMArena Vision1268—

Multilingual GLM-5.1 leads

Gemini 3.5 Flash Lite: 53.5 (#63), GLM-5.1: 55.0 (#36)

BenchmarkGemini 3.5 Flash LiteGLM-5.1
LMArena Non-English14271447
LMArena Chinese14691515
LMArena French14511474
LMArena German14541465
LMArena Japanese14271434
LMArena Korean14071418
LMArena Russian14431454
LMArena Spanish14421469

Instruction Following GLM-5.1 leads

Gemini 3.5 Flash Lite: 74.8 (#85), GLM-5.1: 76.3 (#42)

BenchmarkGemini 3.5 Flash LiteGLM-5.1
LMArena Instruction Following14201451

Long Context GLM-5.1 leads

Gemini 3.5 Flash Lite: 43.9 (#84), GLM-5.1: 44.9 (#53)

BenchmarkGemini 3.5 Flash LiteGLM-5.1
LMArena Longer Query14351466

Writing & Preference GLM-5.1 leads

Gemini 3.5 Flash Lite: 64.2 (#57), GLM-5.1: 66.9 (#31)

BenchmarkGemini 3.5 Flash LiteGLM-5.1
LMArena Text14351461
LMArena Creative Writing14201453
EQ-Bench Creative Writing15591592
LMArena Multi-Turn14451472

Frequently asked questions

Is Gemini 3.5 Flash Lite better than GLM-5.1?

GLM-5.1 is the stronger model overall, scoring 47.8 to 41.5 on the Noometry Index. Gemini 3.5 Flash Lite costs 2.5× less per token, which makes it the better buy when GLM-5.1's lead doesn't matter for your workload.

Which is cheaper, Gemini 3.5 Flash Lite or GLM-5.1?

Gemini 3.5 Flash Lite is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; GLM-5.1 lists at $1.40 and $4.40.

Is Gemini 3.5 Flash Lite or GLM-5.1 better for coding?

GLM-5.1 scores higher on coding benchmarks: 48.7 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.5 Flash Lite does, with 1.05M tokens against 200K.

How many benchmarks do Gemini 3.5 Flash Lite and GLM-5.1 share?

31 benchmarks have published results for both models. Gemini 3.5 Flash Lite has 39 scored results on Noometry and GLM-5.1 has 41.

Related comparisons

Go deeper