Model comparison

GLM-4.6V vs GPT-4o mini

GLM-4.6V is the stronger model overall, scoring 41.3 to 25.5 on the Noometry Index. GPT-4o mini costs 1.7× less per token, which makes it the better buy when GLM-4.6V's lead doesn't matter for your workload.

Last verified . 12 shared benchmarks.

GLM-4.6V Z.ai (Zhipu)

41.3

Rank #137 Confirmed

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

Summary

  • They share 12 benchmarks with published results for both. GLM-4.6V scores higher in 8 categories and GPT-4o mini in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.6V leads 38.0 to 17.7.
  • GPT-4o mini is cheaper at $0.15 / $0.60 per million input/output tokens, against $0.30 / $0.90 for GLM-4.6V.
  • GLM-4.6V has downloadable open weights; the other is API-only.

Side by side

GLM-4.6V and GPT-4o mini specifications
GLM-4.6VGPT-4o mini
ProviderZ.ai (Zhipu)OpenAI
Noometry Index41.325.5
Released2025-12-082024-07-18
WeightsOpenProprietary
Context window128K128K
Max output33K16K
Input $ / M tokens$0.30$0.15
Output $ / M tokens$0.90$0.60
Results tracked1260

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6V leads

GLM-4.6V: 40.9 (#128), GPT-4o mini: 22.0 (#335)

Coding benchmarks
BenchmarkGLM-4.6VGPT-4o mini
LMArena Coding13901290
Aider Polyglot—3.6%
WeirdML—11.8%
BigCodeBench Instruct—46.1%
LiveBench Coding—43.1%
BigCodeBench Complete—57.4%
HumanEval+—83.5%
MBPP+—72.2%

Agentic & Tool Use Not comparable

GLM-4.6V: —, GPT-4o mini: 27.5 (#101)

Agentic & Tool Use benchmarks
BenchmarkGLM-4.6VGPT-4o mini
BALROG—17.4%

Reasoning GLM-4.6V leads

GLM-4.6V: 27.6 (#115), GPT-4o mini: 8.7 (#347)

Reasoning benchmarks
BenchmarkGLM-4.6VGPT-4o mini
LMArena Hard Prompts13681267
ARC-AGI-2—0%
SimpleBench—10.7%
Kagi LLM Benchmark—28.8%
Chess Puzzles—0%
LiveBench Reasoning—32.8%
Mystery Game Puzzles—12%
DTBench—54.4%
LiveBench Data Analysis—50%
LMCA—10.4%
Epoch Capabilities Index—126.56
LiveBench—41.3%
PIQA—88.7%

Math Not comparable

GLM-4.6V: —, GPT-4o mini: 10.4 (#314)

Math benchmarks
BenchmarkGLM-4.6VGPT-4o mini
FrontierMath (Tiers 1-3)—0.7%
OTIS Mock AIME 2024-2025—6.9%
Omni-MATH—28%
LiveBench Math—36.3%
LMArena Math—1267
MATH Level 5—52.6%
GSM8K—91.3%

Knowledge GLM-4.6V leads

GLM-4.6V: 38.0 (#149), GPT-4o mini: 17.7 (#284)

Knowledge benchmarks
BenchmarkGLM-4.6VGPT-4o mini
LMArena Expert13711235
GPQA Diamond—37.7%
SimpleQA Verified—8.3%
MMLU-Pro—60.3%
Confabulations—37.2%
GPQA (HELM)—36.8%
BoolQ—88.7%
MMLU—81.8%

Multimodal GLM-4.6V leads

GLM-4.6V: 34.8 (#90), GPT-4o mini: 25.9 (#122)

Multimodal benchmarks
BenchmarkGLM-4.6VGPT-4o mini
LMArena Vision11641066
Video-MME—64.8%
GeoBench—64%
VPCT—34%

Multilingual GLM-4.6V leads

GLM-4.6V: 48.6 (#141), GPT-4o mini: 42.0 (#199)

Multilingual benchmarks
BenchmarkGLM-4.6VGPT-4o mini
LMArena Non-English13591266
LMArena Chinese14251265
LMArena Russian13401275
LMArena French—1297
LMArena German—1272
LMArena Japanese—1216
LMArena Korean—1195
LMArena Spanish—1276

Instruction Following GLM-4.6V leads

GLM-4.6V: 71.4 (#151), GPT-4o mini: 61.9 (#239)

Instruction Following benchmarks
BenchmarkGLM-4.6VGPT-4o mini
LMArena Instruction Following13521258
LiveBench Instruction Following—56.8%
IFEval—78.2%

Long Context GLM-4.6V leads

GLM-4.6V: 41.3 (#143), GPT-4o mini: 39.1 (#186)

Long Context benchmarks
BenchmarkGLM-4.6VGPT-4o mini
LMArena Longer Query13581289

Writing & Preference GLM-4.6V leads

GLM-4.6V: 56.6 (#137), GPT-4o mini: 39.5 (#248)

Writing & Preference benchmarks
BenchmarkGLM-4.6VGPT-4o mini
LMArena Text13771286
LMArena Creative Writing13471268
LMArena Multi-Turn13601285
Short-Story Creative Writing—67.2%
EQ-Bench Creative Writing—873
WildBench—79.1%
LiveBench Language—28.6%

Frequently asked questions

Is GLM-4.6V better than GPT-4o mini?

GLM-4.6V is the stronger model overall, scoring 41.3 to 25.5 on the Noometry Index. GPT-4o mini costs 1.7× less per token, which makes it the better buy when GLM-4.6V's lead doesn't matter for your workload.

Which is cheaper, GLM-4.6V or GPT-4o mini?

GPT-4o mini is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; GLM-4.6V lists at $0.30 and $0.90.

Is GLM-4.6V or GPT-4o mini better for coding?

GLM-4.6V scores higher on coding benchmarks: 40.9 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do GLM-4.6V and GPT-4o mini share?

12 benchmarks have published results for both models. GLM-4.6V has 12 scored results on Noometry and GPT-4o mini has 60.

Related comparisons

Go deeper