Model comparison

GLM-4.6V vs Mistral Large

GLM-4.6V is the stronger model overall, scoring 41.3 to 31.9 on the Noometry Index.

Last verified . 11 shared benchmarks.

GLM-4.6V Z.ai (Zhipu)

41.3

Rank #137 Confirmed

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Summary

  • They share 11 benchmarks with published results for both. GLM-4.6V scores higher in 7 categories and Mistral Large in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-4.6V leads 56.6 to 40.7.
  • GLM-4.6V is cheaper at $0.30 / $0.90 per million input/output tokens, against $2 / $6 for Mistral Large.
  • Mistral Large accepts more context: 131K tokens versus 128K.

Side by side

GLM-4.6V and Mistral Large specifications
GLM-4.6VMistral Large
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index41.331.9
Released2025-12-082024-02-26
WeightsOpenOpen
Context window128K131K
Max output33K16K
Input $ / M tokens$0.30$2
Output $ / M tokens$0.90$6
Results tracked1251

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.6V leads

GLM-4.6V: 40.9 (#128), Mistral Large: 34.3 (#240)

Coding benchmarks
BenchmarkGLM-4.6VMistral Large
LMArena Coding13901277
SciCode—36.2%
BigCodeBench Instruct—30%
LiveBench Coding—47.1%
BigCodeBench Complete—38.3%
ALE-Bench—264.7
HumanEval+—62.2%
MBPP+—59.5%

Agentic & Tool Use Not comparable

GLM-4.6V: —, Mistral Large: 28.6 (#89)

Agentic & Tool Use benchmarks
BenchmarkGLM-4.6VMistral Large
Berkeley Function Calling Leaderboard—38.4%

Reasoning GLM-4.6V leads

GLM-4.6V: 27.6 (#115), Mistral Large: 15.8 (#310)

Reasoning benchmarks
BenchmarkGLM-4.6VMistral Large
LMArena Hard Prompts13681257
SimpleBench—22.5%
CritPt—0%
LiveBench Reasoning—43.5%
DTBench—65.1%
LiveBench Data Analysis—50.1%
LMCA—16.7%
Epoch Capabilities Index—128.52
ForecastBench—57.1
LiveBench—48.4%

Math Not comparable

GLM-4.6V: —, Mistral Large: 18.2 (#291)

Math benchmarks
BenchmarkGLM-4.6VMistral Large
OTIS Mock AIME 2024-2025—8.5%
Omni-MATH—28.1%
LiveBench Math—42.5%
LMArena Math—1262
MATH Level 5—50.3%
FrontierMath (Feb 2025 set)—0.3%

Knowledge GLM-4.6V leads

GLM-4.6V: 38.0 (#149), Mistral Large: 30.1 (#230)

Knowledge benchmarks
BenchmarkGLM-4.6VMistral Large
LMArena Expert13711232
GPQA Diamond—51.3%
MMLU-Pro—59.9%
Confabulations—21.4%
Vectara Hallucination Rate—4.5%
GPQA (HELM)—43.5%
MMLU—80%

Multimodal Not comparable

GLM-4.6V: 34.8 (#90), Mistral Large: —

Multimodal benchmarks
BenchmarkGLM-4.6VMistral Large
LMArena Vision1164—

Multilingual GLM-4.6V leads

GLM-4.6V: 48.6 (#141), Mistral Large: 40.0 (#219)

Multilingual benchmarks
BenchmarkGLM-4.6VMistral Large
LMArena Non-English13591237
LMArena Chinese14251240
LMArena Russian13401257
LMArena French—1325
LMArena German—1254
LMArena Japanese—1188
LMArena Korean—1202
LMArena Spanish—1268

Instruction Following GLM-4.6V leads

GLM-4.6V: 71.4 (#151), Mistral Large: 67.9 (#191)

Instruction Following benchmarks
BenchmarkGLM-4.6VMistral Large
LMArena Instruction Following13521249
LiveBench Instruction Following—67.9%
IFEval—87.7%

Long Context GLM-4.6V leads

GLM-4.6V: 41.3 (#143), Mistral Large: 38.3 (#199)

Long Context benchmarks
BenchmarkGLM-4.6VMistral Large
LMArena Longer Query13581261

Writing & Preference GLM-4.6V leads

GLM-4.6V: 56.6 (#137), Mistral Large: 40.7 (#242)

Writing & Preference benchmarks
BenchmarkGLM-4.6VMistral Large
LMArena Text13771266
LMArena Creative Writing13471243
LMArena Multi-Turn13601260
Short-Story Creative Writing—69%
EQ-Bench Creative Writing—985
WildBench—80.1%
LiveBench Language—39.4%

Frequently asked questions

Is GLM-4.6V better than Mistral Large?

GLM-4.6V is the stronger model overall, scoring 41.3 to 31.9 on the Noometry Index.

Which is cheaper, GLM-4.6V or Mistral Large?

GLM-4.6V is cheaper. It lists at $0.30 per million input tokens and $0.90 per million output tokens; Mistral Large lists at $2 and $6.

Is GLM-4.6V or Mistral Large better for coding?

GLM-4.6V scores higher on coding benchmarks: 40.9 versus 34.3 in the Noometry coding category.

Which has the bigger context window?

Mistral Large does, with 131K tokens against 128K.

How many benchmarks do GLM-4.6V and Mistral Large share?

11 benchmarks have published results for both models. GLM-4.6V has 12 scored results on Noometry and Mistral Large has 51.

Related comparisons

Go deeper