Noometry

Model comparison

GLM-4.6V vs GPT-4.1 mini

GLM-4.6V is the stronger model overall, scoring 41.3 to 33.6 on the Noometry Index.

Last verified . 12 shared benchmarks.

GLM-4.6V Z.ai (Zhipu)

41.3

Rank #137 Confirmed

GPT-4.1 mini OpenAI

33.6

Rank #240 Confirmed

Summary

  • They share 12 benchmarks with published results for both. GLM-4.6V scores higher in 6 categories and GPT-4.1 mini in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GLM-4.6V leads 27.6 to 10.8.
  • GLM-4.6V is cheaper at $0.30 / $0.90 per million input/output tokens, against $0.40 / $1.60 for GPT-4.1 mini.
  • GPT-4.1 mini accepts more context: 1.05M tokens versus 128K.
  • GLM-4.6V has downloadable open weights; the other is API-only.

Side by side

GLM-4.6VGPT-4.1 mini
ProviderZ.ai (Zhipu)OpenAI
Noometry Index41.333.6
Released2025-12-082025-04-14
WeightsOpenProprietary
Context window128K1.05M
Max output33K33K
Input $ / M tokens$0.30$0.40
Output $ / M tokens$0.90$1.60
Results tracked1247

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6V leads

GLM-4.6V: 40.9 (#128), GPT-4.1 mini: 30.6 (#293)

BenchmarkGLM-4.6VGPT-4.1 mini
LMArena Coding13901367
SWE-bench Verified (bash only)—23.9%
Aider Polyglot—32.4%
SciCode—40.4%
WeirdML—37.6%
BigCodeBench Instruct—48.9%
CadEval—16%

Agentic & Tool Use Not comparable

GLM-4.6V: —, GPT-4.1 mini: 33.3 (#55)

BenchmarkGLM-4.6VGPT-4.1 mini
Berkeley Function Calling Leaderboard—50.5%

Reasoning GLM-4.6V leads

GLM-4.6V: 27.6 (#115), GPT-4.1 mini: 10.8 (#340)

BenchmarkGLM-4.6VGPT-4.1 mini
LMArena Hard Prompts13681349
ARC-AGI-2—0%
Kagi LLM Benchmark—48.6%
ARC-AGI-1—3.5%
CritPt—0%
Chess Puzzles—7%
Mystery Game Puzzles—7%
DTBench—68.8%
LMCA—21.1%
Epoch Capabilities Index—135.01

Math Not comparable

GLM-4.6V: —, GPT-4.1 mini: 24.1 (#270)

BenchmarkGLM-4.6VGPT-4.1 mini
FrontierMath (Tiers 1-3)—6.7%
OTIS Mock AIME 2024-2025—44.7%
Omni-MATH—49.1%
LMArena Math—1343
MATH Level 5—87.3%
FrontierMath (Feb 2025 set)—4.5%

Knowledge GLM-4.6V leads

GLM-4.6V: 38.0 (#149), GPT-4.1 mini: 34.7 (#194)

BenchmarkGLM-4.6VGPT-4.1 mini
LMArena Expert13711338
GPQA Diamond—65.8%
SimpleQA Verified—12.7%
MMLU-Pro—78.3%
GPQA (HELM)—61.4%

Multimodal GPT-4.1 mini leads

GLM-4.6V: 34.8 (#90), GPT-4.1 mini: 35.8 (#82)

BenchmarkGLM-4.6VGPT-4.1 mini
LMArena Vision11641181

Multilingual GLM-4.6V leads

GLM-4.6V: 48.6 (#141), GPT-4.1 mini: 45.7 (#166)

BenchmarkGLM-4.6VGPT-4.1 mini
LMArena Non-English13591318
LMArena Chinese14251329
LMArena Russian13401324
LMArena French—1358
LMArena German—1351
LMArena Japanese—1290
LMArena Korean—1298
LMArena Spanish—1319

Instruction Following GPT-4.1 mini leads

GLM-4.6V: 71.4 (#151), GPT-4.1 mini: 73.7 (#118)

BenchmarkGLM-4.6VGPT-4.1 mini
LMArena Instruction Following13521333
IFEval—90.4%

Long Context GLM-4.6V leads

GLM-4.6V: 41.3 (#143), GPT-4.1 mini: 31.8 (#275)

BenchmarkGLM-4.6VGPT-4.1 mini
LMArena Longer Query13581344
Fiction.LiveBench—44.4%

Writing & Preference GLM-4.6V leads

GLM-4.6V: 56.6 (#137), GPT-4.1 mini: 48.6 (#199)

BenchmarkGLM-4.6VGPT-4.1 mini
LMArena Text13771340
LMArena Creative Writing13471300
LMArena Multi-Turn13601354
EQ-Bench Creative Writing—1147
WildBench—83.8%

Frequently asked questions

Is GLM-4.6V better than GPT-4.1 mini?

GLM-4.6V is the stronger model overall, scoring 41.3 to 33.6 on the Noometry Index.

Which is cheaper, GLM-4.6V or GPT-4.1 mini?

GLM-4.6V is cheaper. It lists at $0.30 per million input tokens and $0.90 per million output tokens; GPT-4.1 mini lists at $0.40 and $1.60.

Is GLM-4.6V or GPT-4.1 mini better for coding?

GLM-4.6V scores higher on coding benchmarks: 40.9 versus 30.6 in the Noometry coding category.

Which has the bigger context window?

GPT-4.1 mini does, with 1.05M tokens against 128K.

How many benchmarks do GLM-4.6V and GPT-4.1 mini share?

12 benchmarks have published results for both models. GLM-4.6V has 12 scored results on Noometry and GPT-4.1 mini has 47.

Related comparisons

Go deeper