Noometry

Model comparison

GLM-4.6 vs GPT-6.1 Sol

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 41.4 on the Noometry Index. GLM-4.6 costs 4.0× less per token, which makes it the better buy when GPT-6.1 Sol's lead doesn't matter for your workload.

Last verified . 15 shared benchmarks.

GLM-4.6 Z.ai (Zhipu)

41.4

Rank #135 Confirmed

GPT-6.1 Sol OpenAI

65.6

Rank #6 Confirmed

Summary

  • They share 15 benchmarks with published results for both. GLM-4.6 scores higher in 0 categories and GPT-6.1 Sol in 9 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-6.1 Sol leads 81.9 to 23.7.
  • The biggest single-benchmark swing is CritPt: 1.1% for GLM-4.6 and 31.7% for GPT-6.1 Sol.
  • GLM-4.6 is cheaper at $0.60 / $2.20 per million input/output tokens, against $2 / $10 for GPT-6.1 Sol.
  • GPT-6.1 Sol accepts more context: 1.05M tokens versus 205K.
  • GLM-4.6 has downloadable open weights; the other is API-only.

Side by side

GLM-4.6GPT-6.1 Sol
ProviderZ.ai (Zhipu)OpenAI
Noometry Index41.465.6
Released2025-09-302026-09-29
WeightsOpenProprietary
Context window205K1.05M
Max output131K128K
Input $ / M tokens$0.60$2
Output $ / M tokens$2.20$10
Results tracked2934

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6.1 Sol leads

GLM-4.6: 40.1 (#148), GPT-6.1 Sol: 63.2 (#8)

BenchmarkGLM-4.6GPT-6.1 Sol
LMArena WebDev13401755
SciCode38.4%55.8%
LMArena Coding14491487
DeepSWE—75.2%
FrontierCode—50.2%
SWE-bench Verified (bash only)55.4%—
ALE-Bench340.82—

Agentic & Tool Use GPT-6.1 Sol leads

GLM-4.6: 32.3 (#66), GPT-6.1 Sol: 39.6 (#26)

BenchmarkGLM-4.6GPT-6.1 Sol
Terminal-Bench24.5%—
APEX-Agents—60%
Berkeley Function Calling Leaderboard72.4%—
GDP.pdf—32%

Reasoning GPT-6.1 Sol leads

GLM-4.6: 23.7 (#172), GPT-6.1 Sol: 81.9 (#2)

BenchmarkGLM-4.6GPT-6.1 Sol
CritPt1.1%31.7%
LMArena Hard Prompts14401466
ARC-AGI-2—94.2%
Kagi LLM Benchmark47.4%—
NYT Connections (extended)—95.5%
ARC-AGI-1—98.5%
Chess Puzzles—61%
EBR-Bench—54.3%
Mystery Game Puzzles—80%
Epoch Capabilities Index—166.09

Math GPT-6.1 Sol leads

GLM-4.6: 39.1 (#111), GPT-6.1 Sol: 93.7 (#1)

BenchmarkGLM-4.6GPT-6.1 Sol
LMArena Math14321464
FrontierMath (Tiers 1-3)—93.7%
FrontierMath Tier 4—100%
OTIS Mock AIME 2024-2025—100%
ProofBench—99%
FrontierMath (Feb 2025 set)3.8%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge GPT-6.1 Sol leads

GLM-4.6: 40.2 (#124), GPT-6.1 Sol: 71.8 (#4)

BenchmarkGLM-4.6GPT-6.1 Sol
LMArena Expert14311502
GPQA Diamond—95.4%
SimpleQA Verified—73.9%
Vectara Hallucination Rate9.5%—

Multimodal Not comparable

GLM-4.6: —, GPT-6.1 Sol: 52.7 (#5)

BenchmarkGLM-4.6GPT-6.1 Sol
LMArena Vision—1288
Furniture Assembly—80%

Multilingual Too close to call

GLM-4.6: 53.5 (#66), GPT-6.1 Sol: 54.3 (#46)

BenchmarkGLM-4.6GPT-6.1 Sol
LMArena Non-English14261438
LMArena Chinese14991477
LMArena Russian14191455
LMArena French1459—
LMArena German1447—
LMArena Japanese1393—
LMArena Korean1400—
LMArena Spanish1436—

Instruction Following GPT-6.1 Sol leads

GLM-4.6: 74.3 (#98), GPT-6.1 Sol: 77.0 (#29)

BenchmarkGLM-4.6GPT-6.1 Sol
LMArena Instruction Following14101468

Long Context GPT-6.1 Sol leads

GLM-4.6: 43.4 (#94), GPT-6.1 Sol: 44.9 (#54)

BenchmarkGLM-4.6GPT-6.1 Sol
LMArena Longer Query14221465

Writing & Preference GPT-6.1 Sol leads

GLM-4.6: 61.1 (#90), GPT-6.1 Sol: 63.6 (#63)

BenchmarkGLM-4.6GPT-6.1 Sol
LMArena Text14401447
LMArena Creative Writing14111432
LMArena Multi-Turn14271449
EQ-Bench Creative Writing1411—

Frequently asked questions

Is GLM-4.6 better than GPT-6.1 Sol?

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 41.4 on the Noometry Index. GLM-4.6 costs 4.0× less per token, which makes it the better buy when GPT-6.1 Sol's lead doesn't matter for your workload.

Which is cheaper, GLM-4.6 or GPT-6.1 Sol?

GLM-4.6 is cheaper. It lists at $0.60 per million input tokens and $2.20 per million output tokens; GPT-6.1 Sol lists at $2 and $10.

Is GLM-4.6 or GPT-6.1 Sol better for coding?

GPT-6.1 Sol scores higher on coding benchmarks: 63.2 versus 40.1 in the Noometry coding category.

Which has the bigger context window?

GPT-6.1 Sol does, with 1.05M tokens against 205K.

How many benchmarks do GLM-4.6 and GPT-6.1 Sol share?

15 benchmarks have published results for both models. GLM-4.6 has 29 scored results on Noometry and GPT-6.1 Sol has 34.

Related comparisons

Go deeper