Noometry

Model comparison

GLM-4.6 vs Grok-3 mini

GLM-4.6 and Grok-3 mini score almost the same on the Noometry Index (41.4 vs 41.2), so choose on price, context window or the category you care about most.

Last verified . 19 shared benchmarks.

GLM-4.6 Z.ai (Zhipu)

41.4

Rank #135 Confirmed

Grok-3 mini xAI

41.2

Rank #141 Confirmed

Summary

  • They share 19 benchmarks with published results for both. GLM-4.6 scores higher in 4 categories and Grok-3 mini in 4 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GLM-4.6 leads 23.7 to 13.6.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 47.4% for GLM-4.6 and 61.3% for Grok-3 mini.
  • GLM-4.6 has downloadable open weights; the other is API-only.

Side by side

GLM-4.6Grok-3 mini
ProviderZ.ai (Zhipu)xAI
Noometry Index41.441.2
Released2025-09-302025-04-09
WeightsOpenProprietary
Context window205K—
Max output131K—
Input $ / M tokens$0.60—
Output $ / M tokens$2.20—
Results tracked2935

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

GLM-4.6: 40.1 (#148), Grok-3 mini: 40.8 (#131)

BenchmarkGLM-4.6Grok-3 mini
LMArena Coding14491379
SWE-bench Verified (bash only)55.4%—
Aider Polyglot—49.3%
LMArena WebDev1340—
SciCode38.4%—
WeirdML—42.6%
ALE-Bench340.82—

Agentic & Tool Use Not comparable

GLM-4.6: 32.3 (#66), Grok-3 mini: —

BenchmarkGLM-4.6Grok-3 mini
Terminal-Bench24.5%—
Berkeley Function Calling Leaderboard72.4%—

Reasoning GLM-4.6 leads

GLM-4.6: 23.7 (#172), Grok-3 mini: 13.6 (#334)

BenchmarkGLM-4.6Grok-3 mini
Kagi LLM Benchmark47.4%61.3%
LMArena Hard Prompts14401375
ARC-AGI-2—0.4%
ARC-AGI-1—16.5%
CritPt1.1%—
Epoch Capabilities Index—140.35

Math Grok-3 mini leads

GLM-4.6: 39.1 (#111), Grok-3 mini: 42.1 (#85)

BenchmarkGLM-4.6Grok-3 mini
LMArena Math14321386
FrontierMath (Feb 2025 set)3.8%5.9%
OTIS Mock AIME 2024-2025—77.8%
Omni-MATH—31.8%
MATH Level 5—90.9%
FrontierMath Tier 4 (v1)2.1%—

Knowledge Grok-3 mini leads

GLM-4.6: 40.2 (#124), Grok-3 mini: 46.4 (#81)

BenchmarkGLM-4.6Grok-3 mini
LMArena Expert14311395
GPQA Diamond—76.3%
MMLU-Pro—79.9%
Confabulations—10.8%
Vectara Hallucination Rate9.5%—
GPQA (HELM)—67.5%

Multilingual GLM-4.6 leads

GLM-4.6: 53.5 (#66), Grok-3 mini: 48.1 (#145)

BenchmarkGLM-4.6Grok-3 mini
LMArena Non-English14261352
LMArena Chinese14991387
LMArena French14591357
LMArena German14471349
LMArena Japanese13931342
LMArena Korean14001335
LMArena Russian14191353
LMArena Spanish14361381

Instruction Following Grok-3 mini leads

GLM-4.6: 74.3 (#98), Grok-3 mini: 78.5 (#9)

BenchmarkGLM-4.6Grok-3 mini
LMArena Instruction Following14101357
IFEval—95.1%

Long Context GLM-4.6 leads

GLM-4.6: 43.4 (#94), Grok-3 mini: 41.0 (#147)

BenchmarkGLM-4.6Grok-3 mini
LMArena Longer Query14221372
Fiction.LiveBench—66.7%

Writing & Preference GLM-4.6 leads

GLM-4.6: 61.1 (#90), Grok-3 mini: 52.5 (#169)

BenchmarkGLM-4.6Grok-3 mini
LMArena Text14401370
LMArena Creative Writing14111342
LMArena Multi-Turn14271355
Short-Story Creative Writing—73.5%
EQ-Bench Creative Writing1411—
WildBench—65.1%

Frequently asked questions

Is GLM-4.6 better than Grok-3 mini?

GLM-4.6 and Grok-3 mini score almost the same on the Noometry Index (41.4 vs 41.2), so choose on price, context window or the category you care about most.

Is GLM-4.6 or Grok-3 mini better for coding?

They score almost the same on coding (40.1 vs 40.8); test both on your own repository before choosing.

How many benchmarks do GLM-4.6 and Grok-3 mini share?

19 benchmarks have published results for both models. GLM-4.6 has 29 scored results on Noometry and Grok-3 mini has 35.

Related comparisons

Go deeper