Noometry

Model comparison

GLM-4.5-Air vs Magistral Small

GLM-4.5-Air is the stronger model overall, scoring 38.7 to 29.9 on the Noometry Index.

Last verified . 1 shared benchmarks.

GLM-4.5-Air Z.ai (Zhipu)

38.7

Rank #169 Confirmed

Magistral Small Mistral AI

29.9

Rank #289 Confirmed

Summary

  • They share 1 benchmark with published results for both. GLM-4.5-Air scores higher in 3 categories and Magistral Small in 1 category; 4 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GLM-4.5-Air leads 23.3 to 6.9.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 43% for GLM-4.5-Air and 6.3% for Magistral Small.
  • GLM-4.5-Air is cheaper at $0.20 / $1.10 per million input/output tokens, against $0.50 / $1.50 for Magistral Small.
  • GLM-4.5-Air accepts more context: 131K tokens versus 128K.

Side by side

GLM-4.5-AirMagistral Small
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index38.729.9
Released2025-07-202025-06-10
WeightsOpenOpen
Context window131K128K
Max output98K40K
Input $ / M tokens$0.20$0.50
Output $ / M tokens$1.10$1.50
Results tracked2710

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Magistral Small leads

GLM-4.5-Air: 34.5 (#225), Magistral Small: 37.8 (#172)

BenchmarkGLM-4.5-AirMagistral Small
SciCode—35.2%
GSO2.9%—
LMArena Coding1397—

Reasoning GLM-4.5-Air leads

GLM-4.5-Air: 23.3 (#166), Magistral Small: 6.9 (#345)

BenchmarkGLM-4.5-AirMagistral Small
Kagi LLM Benchmark43%6.3%
ARC-AGI-2—0%
ARC-AGI-1—5%
CritPt—0.3%
Chess Puzzles—3%
LMArena Hard Prompts1379—
DTBench—61.3%
Epoch Capabilities Index—133.19
ForecastBench59.2—

Math GLM-4.5-Air leads

GLM-4.5-Air: 33.8 (#166), Magistral Small: 24.9 (#253)

BenchmarkGLM-4.5-AirMagistral Small
OTIS Mock AIME 2024-2025—30%
Omni-MATH39.1%—
LMArena Math1396—

Knowledge GLM-4.5-Air leads

GLM-4.5-Air: 34.6 (#184), Magistral Small: 30.9 (#215)

BenchmarkGLM-4.5-AirMagistral Small
GPQA Diamond—56.1%
Humanity's Last Exam8.1%—
MMLU-Pro76.2%—
Vectara Hallucination Rate9.3%—
GPQA (HELM)59.4%—
LMArena Expert1370—

Multilingual Not comparable

GLM-4.5-Air: 49.4 (#130), Magistral Small: —

BenchmarkGLM-4.5-AirMagistral Small
LMArena Non-English1366—
LMArena Chinese1427—
LMArena French1399—
LMArena German1376—
LMArena Japanese1348—
LMArena Korean1306—
LMArena Russian1373—
LMArena Spanish1385—

Instruction Following Not comparable

GLM-4.5-Air: 69.8 (#165), Magistral Small: —

BenchmarkGLM-4.5-AirMagistral Small
IFEval81.2%—
LMArena Instruction Following1353—

Long Context Not comparable

GLM-4.5-Air: 41.6 (#130), Magistral Small: —

BenchmarkGLM-4.5-AirMagistral Small
LMArena Longer Query1367—

Writing & Preference Not comparable

GLM-4.5-Air: 56.1 (#134), Magistral Small: —

BenchmarkGLM-4.5-AirMagistral Small
LMArena Text1384—
LMArena Creative Writing1343—
WildBench78.9%—
LMArena Multi-Turn1371—

Frequently asked questions

Is GLM-4.5-Air better than Magistral Small?

GLM-4.5-Air is the stronger model overall, scoring 38.7 to 29.9 on the Noometry Index.

Which is cheaper, GLM-4.5-Air or Magistral Small?

GLM-4.5-Air is cheaper. It lists at $0.20 per million input tokens and $1.10 per million output tokens; Magistral Small lists at $0.50 and $1.50.

Is GLM-4.5-Air or Magistral Small better for coding?

Magistral Small scores higher on coding benchmarks: 37.8 versus 34.5 in the Noometry coding category.

Which has the bigger context window?

GLM-4.5-Air does, with 131K tokens against 128K.

How many benchmarks do GLM-4.5-Air and Magistral Small share?

1 benchmark has published results for both models. GLM-4.5-Air has 27 scored results on Noometry and Magistral Small has 10.

Related comparisons

Go deeper