Model comparison

GLM-4.7-Flash vs GPT-4o mini

GLM-4.7-Flash is the stronger model overall, scoring 38.8 to 25.5 on the Noometry Index.

Last verified . 20 shared benchmarks.

GLM-4.7-Flash Z.ai (Zhipu)

38.8

Rank #180 Confirmed

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

Summary

  • They share 20 benchmarks with published results for both. GLM-4.7-Flash scores higher in 8 categories and GPT-4o mini in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-4.7-Flash leads 36.1 to 10.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 58.3% for GLM-4.7-Flash and 6.9% for GPT-4o mini.
  • GLM-4.7-Flash is cheaper at $0.06 / $0.40 per million input/output tokens, against $0.15 / $0.60 for GPT-4o mini.
  • GLM-4.7-Flash accepts more context: 200K tokens versus 128K.
  • GLM-4.7-Flash has downloadable open weights; the other is API-only.

Side by side

GLM-4.7-Flash and GPT-4o mini specifications
GLM-4.7-FlashGPT-4o mini
ProviderZ.ai (Zhipu)OpenAI
Noometry Index38.825.5
Released2026-01-192024-07-18
WeightsOpenProprietary
Context window200K128K
Max output131K16K
Input $ / M tokens$0.06$0.15
Output $ / M tokens$0.40$0.60
Results tracked2160

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.7-Flash leads

GLM-4.7-Flash: 40.6 (#135), GPT-4o mini: 22.0 (#335)

Coding benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
LMArena Coding13831290
Aider Polyglot—3.6%
WeirdML—11.8%
BigCodeBench Instruct—46.1%
LiveBench Coding—43.1%
BigCodeBench Complete—57.4%
HumanEval+—83.5%
MBPP+—72.2%

Agentic & Tool Use Not comparable

GLM-4.7-Flash: —, GPT-4o mini: 27.5 (#101)

Agentic & Tool Use benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
BALROG—17.4%

Reasoning GLM-4.7-Flash leads

GLM-4.7-Flash: 20.9 (#229), GPT-4o mini: 8.7 (#347)

Reasoning benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
Chess Puzzles0%0%
LMArena Hard Prompts13561267
ARC-AGI-2—0%
SimpleBench—10.7%
Kagi LLM Benchmark—28.8%
LiveBench Reasoning—32.8%
Mystery Game Puzzles—12%
DTBench—54.4%
LiveBench Data Analysis—50%
LMCA—10.4%
Epoch Capabilities Index—126.56
LiveBench—41.3%
PIQA—88.7%

Math GLM-4.7-Flash leads

GLM-4.7-Flash: 36.1 (#173), GPT-4o mini: 10.4 (#314)

Math benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
OTIS Mock AIME 2024-202558.3%6.9%
LMArena Math13551267
FrontierMath (Tiers 1-3)—0.7%
Omni-MATH—28%
LiveBench Math—36.3%
MATH Level 5—52.6%
GSM8K—91.3%

Knowledge GLM-4.7-Flash leads

GLM-4.7-Flash: 35.5 (#184), GPT-4o mini: 17.7 (#284)

Knowledge benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
GPQA Diamond60.5%37.7%
LMArena Expert13571235
SimpleQA Verified—8.3%
MMLU-Pro—60.3%
Confabulations—37.2%
Vectara Hallucination Rate9.3%—
GPQA (HELM)—36.8%
BoolQ—88.7%
MMLU—81.8%

Multimodal Not comparable

GLM-4.7-Flash: —, GPT-4o mini: 25.9 (#122)

Multimodal benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
LMArena Vision—1066
Video-MME—64.8%
GeoBench—64%
VPCT—34%

Multilingual GLM-4.7-Flash leads

GLM-4.7-Flash: 46.5 (#158), GPT-4o mini: 42.0 (#199)

Multilingual benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
LMArena Non-English13301266
LMArena Chinese14031265
LMArena French13321297
LMArena German13371272
LMArena Korean12831195
LMArena Russian13321275
LMArena Spanish13501276
LMArena Japanese—1216

Instruction Following GLM-4.7-Flash leads

GLM-4.7-Flash: 70.1 (#167), GPT-4o mini: 61.9 (#239)

Instruction Following benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
LMArena Instruction Following13271258
LiveBench Instruction Following—56.8%
IFEval—78.2%

Long Context GLM-4.7-Flash leads

GLM-4.7-Flash: 40.9 (#148), GPT-4o mini: 39.1 (#186)

Long Context benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
LMArena Longer Query13451289

Writing & Preference GLM-4.7-Flash leads

GLM-4.7-Flash: 47.4 (#210), GPT-4o mini: 39.5 (#248)

Writing & Preference benchmarks
BenchmarkGLM-4.7-FlashGPT-4o mini
LMArena Text13511286
LMArena Creative Writing12971268
EQ-Bench Creative Writing1125873
LMArena Multi-Turn13421285
Short-Story Creative Writing—67.2%
WildBench—79.1%
LiveBench Language—28.6%

Frequently asked questions

Is GLM-4.7-Flash better than GPT-4o mini?

GLM-4.7-Flash is the stronger model overall, scoring 38.8 to 25.5 on the Noometry Index.

Which is cheaper, GLM-4.7-Flash or GPT-4o mini?

GLM-4.7-Flash is cheaper. It lists at $0.06 per million input tokens and $0.40 per million output tokens; GPT-4o mini lists at $0.15 and $0.60.

Is GLM-4.7-Flash or GPT-4o mini better for coding?

GLM-4.7-Flash scores higher on coding benchmarks: 40.6 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

GLM-4.7-Flash does, with 200K tokens against 128K.

How many benchmarks do GLM-4.7-Flash and GPT-4o mini share?

20 benchmarks have published results for both models. GLM-4.7-Flash has 21 scored results on Noometry and GPT-4o mini has 60.

Related comparisons

Go deeper