Noometry

Model comparison

Gemini 1.5 Flash 8B vs GLM-4.7-Flash

GLM-4.7-Flash is the stronger model overall, scoring 38.4 to 29.7 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.7

Rank #292 Confirmed

GLM-4.7-Flash Z.ai (Zhipu)

38.4

Rank #175 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and GLM-4.7-Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-4.7-Flash leads 34.4 to 13.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 58.3% for GLM-4.7-Flash.
  • GLM-4.7-Flash has downloadable open weights; the other is API-only.

Side by side

Gemini 1.5 Flash 8BGLM-4.7-Flash
ProviderGoogleZ.ai (Zhipu)
Noometry Index29.738.4
Released2024-10-032026-01-19
WeightsProprietaryOpen
Context window—200K
Max output—131K
Input $ / M tokens—$0.06
Output $ / M tokens—$0.40
Results tracked2121

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.7-Flash leads

Gemini 1.5 Flash 8B: 34.9 (#221), GLM-4.7-Flash: 40.0 (#133)

BenchmarkGemini 1.5 Flash 8BGLM-4.7-Flash
LMArena Coding12181383

Reasoning GLM-4.7-Flash leads

Gemini 1.5 Flash 8B: 19.2 (#242), GLM-4.7-Flash: 20.2 (#224)

BenchmarkGemini 1.5 Flash 8BGLM-4.7-Flash
LMArena Hard Prompts12101356
Chess Puzzles—0%
DTBench50%—

Math GLM-4.7-Flash leads

Gemini 1.5 Flash 8B: 13.3 (#296), GLM-4.7-Flash: 34.4 (#159)

BenchmarkGemini 1.5 Flash 8BGLM-4.7-Flash
OTIS Mock AIME 2024-20254.6%58.3%
LMArena Math12071354

Knowledge GLM-4.7-Flash leads

Gemini 1.5 Flash 8B: 16.0 (#285), GLM-4.7-Flash: 35.4 (#177)

BenchmarkGemini 1.5 Flash 8BGLM-4.7-Flash
GPQA Diamond33%60.5%
LMArena Expert11851357
Vectara Hallucination Rate—9.3%

Multimodal Not comparable

Gemini 1.5 Flash 8B: 27.6 (#110), GLM-4.7-Flash: —

BenchmarkGemini 1.5 Flash 8BGLM-4.7-Flash
LMArena Vision1044—

Multilingual GLM-4.7-Flash leads

Gemini 1.5 Flash 8B: 38.6 (#224), GLM-4.7-Flash: 46.8 (#152)

BenchmarkGemini 1.5 Flash 8BGLM-4.7-Flash
LMArena Non-English12151331
LMArena Chinese12311403
LMArena French12331332
LMArena German12061336
LMArena Korean11401284
LMArena Russian12361333
LMArena Spanish12121351
LMArena Japanese1150—

Instruction Following GLM-4.7-Flash leads

Gemini 1.5 Flash 8B: 63.1 (#231), GLM-4.7-Flash: 70.3 (#162)

BenchmarkGemini 1.5 Flash 8BGLM-4.7-Flash
LMArena Instruction Following11991327

Long Context GLM-4.7-Flash leads

Gemini 1.5 Flash 8B: 36.9 (#220), GLM-4.7-Flash: 40.9 (#143)

BenchmarkGemini 1.5 Flash 8BGLM-4.7-Flash
LMArena Longer Query12191345

Writing & Preference GLM-4.7-Flash leads

Gemini 1.5 Flash 8B: 43.0 (#227), GLM-4.7-Flash: 47.7 (#206)

BenchmarkGemini 1.5 Flash 8BGLM-4.7-Flash
LMArena Text12261351
LMArena Creative Writing12181297
LMArena Multi-Turn11851342
EQ-Bench Creative Writing—1125

Frequently asked questions

Is Gemini 1.5 Flash 8B better than GLM-4.7-Flash?

GLM-4.7-Flash is the stronger model overall, scoring 38.4 to 29.7 on the Noometry Index.

Is Gemini 1.5 Flash 8B or GLM-4.7-Flash better for coding?

GLM-4.7-Flash scores higher on coding benchmarks: 40.0 versus 34.9 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and GLM-4.7-Flash share?

18 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and GLM-4.7-Flash has 21.

Related comparisons

Go deeper