Noometry

Model comparison

GLM-4.5-Air vs Mistral Medium 3.5

GLM-4.5-Air and Mistral Medium 3.5 score almost the same on the Noometry Index (38.7 vs 39.6), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

GLM-4.5-Air Z.ai (Zhipu)

38.7

Rank #169 Confirmed

Mistral Medium 3.5 Mistral AI

39.6

Rank #151 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GLM-4.5-Air scores higher in 1 category and Mistral Medium 3.5 in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GLM-4.5-Air leads 23.3 to 16.6.
  • GLM-4.5-Air is cheaper at $0.20 / $1.10 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium 3.5.
  • Mistral Medium 3.5 accepts more context: 262K tokens versus 131K.

Side by side

GLM-4.5-AirMistral Medium 3.5
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index38.739.6
Released2025-07-20—
WeightsOpenOpen
Context window131K262K
Max output98K210K
Input $ / M tokens$0.20$1.50
Output $ / M tokens$1.10$7.50
Results tracked2722

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium 3.5 leads

GLM-4.5-Air: 34.5 (#225), Mistral Medium 3.5: 35.7 (#208)

BenchmarkGLM-4.5-AirMistral Medium 3.5
LMArena Coding13971461
LMArena WebDev—1263
GSO2.9%—

Reasoning GLM-4.5-Air leads

GLM-4.5-Air: 23.3 (#166), Mistral Medium 3.5: 16.6 (#290)

BenchmarkGLM-4.5-AirMistral Medium 3.5
Kagi LLM Benchmark43%41.4%
LMArena Hard Prompts13791436
NYT Connections (extended)—12.9%
Epoch Capabilities Index—141.42
ForecastBench59.2—

Math Mistral Medium 3.5 leads

GLM-4.5-Air: 33.8 (#166), Mistral Medium 3.5: 36.4 (#113)

BenchmarkGLM-4.5-AirMistral Medium 3.5
LMArena Math13961432
Omni-MATH39.1%—

Knowledge Mistral Medium 3.5 leads

GLM-4.5-Air: 34.6 (#184), Mistral Medium 3.5: 39.3 (#123)

BenchmarkGLM-4.5-AirMistral Medium 3.5
LMArena Expert13701431
Humanity's Last Exam8.1%—
MMLU-Pro76.2%—
Vectara Hallucination Rate9.3%—
GPQA (HELM)59.4%—

Multimodal Not comparable

GLM-4.5-Air: —, Mistral Medium 3.5: 37.6 (#64)

BenchmarkGLM-4.5-AirMistral Medium 3.5
LMArena Vision—1222

Multilingual Mistral Medium 3.5 leads

GLM-4.5-Air: 49.4 (#130), Mistral Medium 3.5: 52.1 (#93)

BenchmarkGLM-4.5-AirMistral Medium 3.5
LMArena Non-English13661405
LMArena Chinese14271443
LMArena French13991448
LMArena German13761453
LMArena Korean13061387
LMArena Russian13731396
LMArena Spanish13851406
LMArena Japanese1348—

Instruction Following Mistral Medium 3.5 leads

GLM-4.5-Air: 69.8 (#165), Mistral Medium 3.5: 74.7 (#87)

BenchmarkGLM-4.5-AirMistral Medium 3.5
LMArena Instruction Following13531414
IFEval81.2%—

Long Context Mistral Medium 3.5 leads

GLM-4.5-Air: 41.6 (#130), Mistral Medium 3.5: 43.2 (#101)

BenchmarkGLM-4.5-AirMistral Medium 3.5
LMArena Longer Query13671414

Writing & Preference Mistral Medium 3.5 leads

GLM-4.5-Air: 56.1 (#134), Mistral Medium 3.5: 58.6 (#113)

BenchmarkGLM-4.5-AirMistral Medium 3.5
LMArena Text13841421
LMArena Creative Writing13431372
LMArena Multi-Turn13711423
WildBench78.9%—
EQ-Bench 4—993

Frequently asked questions

Is GLM-4.5-Air better than Mistral Medium 3.5?

GLM-4.5-Air and Mistral Medium 3.5 score almost the same on the Noometry Index (38.7 vs 39.6), so choose on price, context window or the category you care about most.

Which is cheaper, GLM-4.5-Air or Mistral Medium 3.5?

GLM-4.5-Air is cheaper. It lists at $0.20 per million input tokens and $1.10 per million output tokens; Mistral Medium 3.5 lists at $1.50 and $7.50.

Is GLM-4.5-Air or Mistral Medium 3.5 better for coding?

Mistral Medium 3.5 scores higher on coding benchmarks: 35.7 versus 34.5 in the Noometry coding category.

Which has the bigger context window?

Mistral Medium 3.5 does, with 262K tokens against 131K.

How many benchmarks do GLM-4.5-Air and Mistral Medium 3.5 share?

17 benchmarks have published results for both models. GLM-4.5-Air has 27 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper