Noometry

Model comparison

GLM-4.5 vs Mistral Small 3

GLM-4.5 is the stronger model overall, scoring 42.0 to 31.2 on the Noometry Index. Mistral Small 3 costs 17× less per token, which makes it the better buy when GLM-4.5's lead doesn't matter for your workload.

Last verified . 18 shared benchmarks.

GLM-4.5 Z.ai (Zhipu)

42.0

Rank #122 Confirmed

Mistral Small 3 Mistral AI

31.2

Rank #278 Confirmed

Summary

  • They share 18 benchmarks with published results for both. GLM-4.5 scores higher in 8 categories and Mistral Small 3 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-4.5 leads 57.5 to 32.2.
  • The biggest single-benchmark swing is Confabulations: 11.3% for GLM-4.5 and 25.2% for Mistral Small 3.
  • Mistral Small 3 is cheaper at $0.05 / $0.08 per million input/output tokens, against $0.60 / $2.20 for GLM-4.5.
  • GLM-4.5 accepts more context: 131K tokens versus 33K.

Side by side

GLM-4.5Mistral Small 3
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index42.031.2
Released2025-07-272025-01-30
WeightsOpenOpen
Context window131K33K
Max output98K16K
Input $ / M tokens$0.60$0.05
Output $ / M tokens$2.20$0.08
Results tracked2724

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5 leads

GLM-4.5: 41.4 (#125), Mistral Small 3: 36.5 (#207)

BenchmarkGLM-4.5Mistral Small 3
LMArena Coding14341246
SWE-bench Verified (bash only)54.2%—
WeirdML40.6%—
BigCodeBench Instruct—45.3%
BigCodeBench Complete—50.4%
ALE-Bench344.82—
AlgoTune1.52—

Reasoning GLM-4.5 leads

GLM-4.5: 28.6 (#100), Mistral Small 3: 18.9 (#273)

BenchmarkGLM-4.5Mistral Small 3
LMArena Hard Prompts14291233
Kagi LLM Benchmark57.9%—
Chess Puzzles—0%
Epoch Capabilities Index—127.07

Math GLM-4.5 leads

GLM-4.5: 39.0 (#116), Mistral Small 3: 16.3 (#295)

BenchmarkGLM-4.5Mistral Small 3
LMArena Math14271240
OTIS Mock AIME 2024-2025—6.7%

Knowledge GLM-4.5 leads

GLM-4.5: 35.9 (#179), Mistral Small 3: 25.1 (#263)

BenchmarkGLM-4.5Mistral Small 3
Confabulations11.3%25.2%
LMArena Expert14331202
GPQA Diamond—47.3%
Humanity's Last Exam8.3%—

Multilingual GLM-4.5 leads

GLM-4.5: 52.8 (#77), Mistral Small 3: 37.3 (#236)

BenchmarkGLM-4.5Mistral Small 3
LMArena Non-English14171198
LMArena Chinese14651204
LMArena French14181203
LMArena German14071211
LMArena Japanese14151111
LMArena Korean13801188
LMArena Russian14141216
LMArena Spanish1454—

Instruction Following GLM-4.5 leads

GLM-4.5: 74.1 (#104), Mistral Small 3: 63.7 (#229)

BenchmarkGLM-4.5Mistral Small 3
LMArena Instruction Following14041214

Long Context Too close to call

GLM-4.5: 38.2 (#201), Mistral Small 3: 37.8 (#211)

BenchmarkGLM-4.5Mistral Small 3
LMArena Longer Query14121246
Fiction.LiveBench58.3%—

Writing & Preference GLM-4.5 leads

GLM-4.5: 57.5 (#127), Mistral Small 3: 32.2 (#280)

BenchmarkGLM-4.5Mistral Small 3
LMArena Text14301234
LMArena Creative Writing13951195
EQ-Bench Creative Writing1343707
LMArena Multi-Turn14151217
Short-Story Creative Writing73.4%—

Frequently asked questions

Is GLM-4.5 better than Mistral Small 3?

GLM-4.5 is the stronger model overall, scoring 42.0 to 31.2 on the Noometry Index. Mistral Small 3 costs 17× less per token, which makes it the better buy when GLM-4.5's lead doesn't matter for your workload.

Which is cheaper, GLM-4.5 or Mistral Small 3?

Mistral Small 3 is cheaper. It lists at $0.05 per million input tokens and $0.08 per million output tokens; GLM-4.5 lists at $0.60 and $2.20.

Is GLM-4.5 or Mistral Small 3 better for coding?

GLM-4.5 scores higher on coding benchmarks: 41.4 versus 36.5 in the Noometry coding category.

Which has the bigger context window?

GLM-4.5 does, with 131K tokens against 33K.

How many benchmarks do GLM-4.5 and Mistral Small 3 share?

18 benchmarks have published results for both models. GLM-4.5 has 27 scored results on Noometry and Mistral Small 3 has 24.

Related comparisons

Go deeper