Noometry

Model comparison

GLM-4.5-Air vs Mixtral 8x22B

GLM-4.5-Air is the stronger model overall, scoring 38.7 to 26.7 on the Noometry Index.

Last verified . 23 shared benchmarks.

GLM-4.5-Air Z.ai (Zhipu)

38.7

Rank #169 Confirmed

Mixtral 8x22B Mistral AI

26.7

Rank #330 Confirmed

Summary

  • They share 23 benchmarks with published results for both. GLM-4.5-Air scores higher in 8 categories and Mixtral 8x22B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-4.5-Air leads 34.6 to 15.1.
  • The biggest single-benchmark swing is MMLU-Pro: 76.2% for GLM-4.5-Air and 46% for Mixtral 8x22B.
  • GLM-4.5-Air is cheaper at $0.20 / $1.10 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • GLM-4.5-Air accepts more context: 131K tokens versus 64K.

Side by side

GLM-4.5-AirMixtral 8x22B
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index38.726.7
Released2025-07-202024-04-17
WeightsOpenOpen
Context window131K64K
Max output98K64K
Input $ / M tokens$0.20$2
Output $ / M tokens$1.10$6
Results tracked2734

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5-Air leads

GLM-4.5-Air: 34.5 (#225), Mixtral 8x22B: 23.8 (#324)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Coding13971166
GSO2.9%—
WeirdML—3.2%
BigCodeBench Instruct—40.6%
BigCodeBench Complete—50.2%
HumanEval+—72%
MBPP+—64.3%

Agentic & Tool Use Not comparable

GLM-4.5-Air: —, Mixtral 8x22B: 22.8 (#119)

BenchmarkGLM-4.5-AirMixtral 8x22B
Cybench—7.5%

Reasoning GLM-4.5-Air leads

GLM-4.5-Air: 23.3 (#166), Mixtral 8x22B: 19.1 (#246)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Hard Prompts13791150
ForecastBench59.256.3
Kagi LLM Benchmark43%—
DTBench—55.1%
Epoch Capabilities Index—122

Math GLM-4.5-Air leads

GLM-4.5-Air: 33.8 (#166), Mixtral 8x22B: 21.2 (#271)

BenchmarkGLM-4.5-AirMixtral 8x22B
Omni-MATH39.1%16.3%
LMArena Math13961184
MATH Level 5—24.2%

Knowledge GLM-4.5-Air leads

GLM-4.5-Air: 34.6 (#184), Mixtral 8x22B: 15.1 (#288)

BenchmarkGLM-4.5-AirMixtral 8x22B
MMLU-Pro76.2%46%
GPQA (HELM)59.4%33.4%
LMArena Expert13701113
GPQA Diamond—34.1%
Humanity's Last Exam8.1%—
Vectara Hallucination Rate9.3%—
MMLU—77.8%

Multilingual GLM-4.5-Air leads

GLM-4.5-Air: 49.4 (#130), Mixtral 8x22B: 32.9 (#250)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Non-English13661128
LMArena Chinese14271116
LMArena French13991165
LMArena German13761141
LMArena Japanese13481037
LMArena Korean13061056
LMArena Russian13731158
LMArena Spanish13851150

Instruction Following GLM-4.5-Air leads

GLM-4.5-Air: 69.8 (#165), Mixtral 8x22B: 57.9 (#261)

BenchmarkGLM-4.5-AirMixtral 8x22B
IFEval81.2%72.4%
LMArena Instruction Following13531147

Long Context GLM-4.5-Air leads

GLM-4.5-Air: 41.6 (#130), Mixtral 8x22B: 34.6 (#242)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Longer Query13671144

Writing & Preference GLM-4.5-Air leads

GLM-4.5-Air: 56.1 (#134), Mixtral 8x22B: 37.1 (#257)

BenchmarkGLM-4.5-AirMixtral 8x22B
LMArena Text13841162
LMArena Creative Writing13431141
WildBench78.9%71.1%
LMArena Multi-Turn13711130

Frequently asked questions

Is GLM-4.5-Air better than Mixtral 8x22B?

GLM-4.5-Air is the stronger model overall, scoring 38.7 to 26.7 on the Noometry Index.

Which is cheaper, GLM-4.5-Air or Mixtral 8x22B?

GLM-4.5-Air is cheaper. It lists at $0.20 per million input tokens and $1.10 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is GLM-4.5-Air or Mixtral 8x22B better for coding?

GLM-4.5-Air scores higher on coding benchmarks: 34.5 versus 23.8 in the Noometry coding category.

Which has the bigger context window?

GLM-4.5-Air does, with 131K tokens against 64K.

How many benchmarks do GLM-4.5-Air and Mixtral 8x22B share?

23 benchmarks have published results for both models. GLM-4.5-Air has 27 scored results on Noometry and Mixtral 8x22B has 34.

Related comparisons

Go deeper