Noometry

Model comparison

GLM-4.6 vs Mistral Large

GLM-4.6 is the stronger model overall, scoring 41.4 to 31.9 on the Noometry Index.

Last verified . 24 shared benchmarks.

GLM-4.6 Z.ai (Zhipu)

41.4

Rank #135 Confirmed

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Summary

  • They share 24 benchmarks with published results for both. GLM-4.6 scores higher in 9 categories and Mistral Large in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where GLM-4.6 leads 39.1 to 18.2.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 72.4% for GLM-4.6 and 38.4% for Mistral Large.
  • GLM-4.6 is cheaper at $0.60 / $2.20 per million input/output tokens, against $2 / $6 for Mistral Large.
  • GLM-4.6 accepts more context: 205K tokens versus 131K.

Side by side

GLM-4.6Mistral Large
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index41.431.9
Released2025-09-302024-02-26
WeightsOpenOpen
Context window205K131K
Max output131K16K
Input $ / M tokens$0.60$2
Output $ / M tokens$2.20$6
Results tracked2951

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6 leads

GLM-4.6: 40.1 (#148), Mistral Large: 34.3 (#240)

BenchmarkGLM-4.6Mistral Large
SciCode38.4%36.2%
LMArena Coding14491277
ALE-Bench340.82264.7
SWE-bench Verified (bash only)55.4%—
LMArena WebDev1340—
BigCodeBench Instruct—30%
LiveBench Coding—47.1%
BigCodeBench Complete—38.3%
HumanEval+—62.2%
MBPP+—59.5%

Agentic & Tool Use GLM-4.6 leads

GLM-4.6: 32.3 (#66), Mistral Large: 28.6 (#89)

BenchmarkGLM-4.6Mistral Large
Berkeley Function Calling Leaderboard72.4%38.4%
Terminal-Bench24.5%—

Reasoning GLM-4.6 leads

GLM-4.6: 23.7 (#172), Mistral Large: 15.8 (#310)

BenchmarkGLM-4.6Mistral Large
CritPt1.1%0%
LMArena Hard Prompts14401257
SimpleBench—22.5%
Kagi LLM Benchmark47.4%—
LiveBench Reasoning—43.5%
DTBench—65.1%
LiveBench Data Analysis—50.1%
LMCA—16.7%
Epoch Capabilities Index—128.52
ForecastBench—57.1
LiveBench—48.4%

Math GLM-4.6 leads

GLM-4.6: 39.1 (#111), Mistral Large: 18.2 (#291)

BenchmarkGLM-4.6Mistral Large
LMArena Math14321262
FrontierMath (Feb 2025 set)3.8%0.3%
OTIS Mock AIME 2024-2025—8.5%
Omni-MATH—28.1%
LiveBench Math—42.5%
MATH Level 5—50.3%
FrontierMath Tier 4 (v1)2.1%—

Knowledge GLM-4.6 leads

GLM-4.6: 40.2 (#124), Mistral Large: 30.1 (#230)

BenchmarkGLM-4.6Mistral Large
Vectara Hallucination Rate9.5%4.5%
LMArena Expert14311232
GPQA Diamond—51.3%
MMLU-Pro—59.9%
Confabulations—21.4%
GPQA (HELM)—43.5%
MMLU—80%

Multilingual GLM-4.6 leads

GLM-4.6: 53.5 (#66), Mistral Large: 40.0 (#219)

BenchmarkGLM-4.6Mistral Large
LMArena Non-English14261237
LMArena Chinese14991240
LMArena French14591325
LMArena German14471254
LMArena Japanese13931188
LMArena Korean14001202
LMArena Russian14191257
LMArena Spanish14361268

Instruction Following GLM-4.6 leads

GLM-4.6: 74.3 (#98), Mistral Large: 67.9 (#191)

BenchmarkGLM-4.6Mistral Large
LMArena Instruction Following14101249
LiveBench Instruction Following—67.9%
IFEval—87.7%

Long Context GLM-4.6 leads

GLM-4.6: 43.4 (#94), Mistral Large: 38.3 (#199)

BenchmarkGLM-4.6Mistral Large
LMArena Longer Query14221261

Writing & Preference GLM-4.6 leads

GLM-4.6: 61.1 (#90), Mistral Large: 40.7 (#242)

BenchmarkGLM-4.6Mistral Large
LMArena Text14401266
LMArena Creative Writing14111243
EQ-Bench Creative Writing1411985
LMArena Multi-Turn14271260
Short-Story Creative Writing—69%
WildBench—80.1%
LiveBench Language—39.4%

Frequently asked questions

Is GLM-4.6 better than Mistral Large?

GLM-4.6 is the stronger model overall, scoring 41.4 to 31.9 on the Noometry Index.

Which is cheaper, GLM-4.6 or Mistral Large?

GLM-4.6 is cheaper. It lists at $0.60 per million input tokens and $2.20 per million output tokens; Mistral Large lists at $2 and $6.

Is GLM-4.6 or Mistral Large better for coding?

GLM-4.6 scores higher on coding benchmarks: 40.1 versus 34.3 in the Noometry coding category.

Which has the bigger context window?

GLM-4.6 does, with 205K tokens against 131K.

How many benchmarks do GLM-4.6 and Mistral Large share?

24 benchmarks have published results for both models. GLM-4.6 has 29 scored results on Noometry and Mistral Large has 51.

Related comparisons

Go deeper