Noometry

Model comparison

GLM-4.5-Air vs Mistral Small 3

GLM-4.5-Air is the stronger model overall, scoring 38.7 to 30.9 on the Noometry Index. Mistral Small 3 costs 7.4× less per token, which makes it the better buy when GLM-4.5-Air's lead doesn't matter for your workload.

Last verified . 16 shared benchmarks.

GLM-4.5-Air Z.ai (Zhipu)

38.7

Rank #169 Confirmed

Mistral Small 3 Mistral AI

30.9

Rank #268 Confirmed

Summary

  • They share 16 benchmarks with published results for both. GLM-4.5-Air scores higher in 7 categories and Mistral Small 3 in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-4.5-Air leads 56.1 to 32.4.
  • Mistral Small 3 is cheaper at $0.05 / $0.08 per million input/output tokens, against $0.20 / $1.10 for GLM-4.5-Air.
  • GLM-4.5-Air accepts more context: 131K tokens versus 33K.

Side by side

GLM-4.5-AirMistral Small 3
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index38.730.9
Released2025-07-202025-01-30
WeightsOpenOpen
Context window131K33K
Max output98K16K
Input $ / M tokens$0.20$0.05
Output $ / M tokens$1.10$0.08
Results tracked2724

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3 leads

GLM-4.5-Air: 34.5 (#225), Mistral Small 3: 36.0 (#203)

BenchmarkGLM-4.5-AirMistral Small 3
LMArena Coding13971246
GSO2.9%—
BigCodeBench Instruct—45.3%
BigCodeBench Complete—50.4%

Reasoning GLM-4.5-Air leads

GLM-4.5-Air: 23.3 (#166), Mistral Small 3: 18.2 (#269)

BenchmarkGLM-4.5-AirMistral Small 3
LMArena Hard Prompts13791233
Kagi LLM Benchmark43%—
Chess Puzzles—0%
Epoch Capabilities Index—127.06
ForecastBench59.2—

Math GLM-4.5-Air leads

GLM-4.5-Air: 33.8 (#166), Mistral Small 3: 15.3 (#290)

BenchmarkGLM-4.5-AirMistral Small 3
LMArena Math13961240
OTIS Mock AIME 2024-2025—6.7%
Omni-MATH39.1%—

Knowledge GLM-4.5-Air leads

GLM-4.5-Air: 34.6 (#184), Mistral Small 3: 25.0 (#258)

BenchmarkGLM-4.5-AirMistral Small 3
LMArena Expert13701202
GPQA Diamond—47.3%
Humanity's Last Exam8.1%—
MMLU-Pro76.2%—
Confabulations—25.2%
Vectara Hallucination Rate9.3%—
GPQA (HELM)59.4%—

Multilingual GLM-4.5-Air leads

GLM-4.5-Air: 49.4 (#130), Mistral Small 3: 37.5 (#231)

BenchmarkGLM-4.5-AirMistral Small 3
LMArena Non-English13661198
LMArena Chinese14271204
LMArena French13991202
LMArena German13761211
LMArena Japanese13481111
LMArena Korean13061188
LMArena Russian13731216
LMArena Spanish1385—

Instruction Following GLM-4.5-Air leads

GLM-4.5-Air: 69.8 (#165), Mistral Small 3: 63.9 (#224)

BenchmarkGLM-4.5-AirMistral Small 3
LMArena Instruction Following13531214
IFEval81.2%—

Long Context GLM-4.5-Air leads

GLM-4.5-Air: 41.6 (#130), Mistral Small 3: 37.8 (#206)

BenchmarkGLM-4.5-AirMistral Small 3
LMArena Longer Query13671246

Writing & Preference GLM-4.5-Air leads

GLM-4.5-Air: 56.1 (#134), Mistral Small 3: 32.4 (#275)

BenchmarkGLM-4.5-AirMistral Small 3
LMArena Text13841234
LMArena Creative Writing13431195
LMArena Multi-Turn13711217
EQ-Bench Creative Writing—707
WildBench78.9%—

Frequently asked questions

Is GLM-4.5-Air better than Mistral Small 3?

GLM-4.5-Air is the stronger model overall, scoring 38.7 to 30.9 on the Noometry Index. Mistral Small 3 costs 7.4× less per token, which makes it the better buy when GLM-4.5-Air's lead doesn't matter for your workload.

Which is cheaper, GLM-4.5-Air or Mistral Small 3?

Mistral Small 3 is cheaper. It lists at $0.05 per million input tokens and $0.08 per million output tokens; GLM-4.5-Air lists at $0.20 and $1.10.

Is GLM-4.5-Air or Mistral Small 3 better for coding?

Mistral Small 3 scores higher on coding benchmarks: 36.0 versus 34.5 in the Noometry coding category.

Which has the bigger context window?

GLM-4.5-Air does, with 131K tokens against 33K.

How many benchmarks do GLM-4.5-Air and Mistral Small 3 share?

16 benchmarks have published results for both models. GLM-4.5-Air has 27 scored results on Noometry and Mistral Small 3 has 24.

Related comparisons

Go deeper