Noometry

Model comparison

GLM-4.5-Air vs Llama 4 Scout

GLM-4.5-Air is the stronger model overall, scoring 38.9 to 27.7 on the Noometry Index. Llama 4 Scout costs 2.8× less per token, which makes it the better buy when GLM-4.5-Air's lead doesn't matter for your workload.

Last verified . 25 shared benchmarks.

GLM-4.5-Air Z.ai (Zhipu)

38.9

Rank #177 Confirmed

Llama 4 Scout Meta

27.7

Rank #330 Confirmed

Summary

  • They share 25 benchmarks with published results for both. GLM-4.5-Air scores higher in 8 categories and Llama 4 Scout in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GLM-4.5-Air leads 55.9 to 37.0.
  • The biggest single-benchmark swing is GPQA (HELM): 59.4% for GLM-4.5-Air and 50.7% for Llama 4 Scout.
  • Llama 4 Scout is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.20 / $1.10 for GLM-4.5-Air.
  • GLM-4.5-Air accepts more context: 131K tokens versus 128K.

Side by side

GLM-4.5-AirLlama 4 Scout
ProviderZ.ai (Zhipu)Meta
Noometry Index38.927.7
Released2025-07-202025-04-05
WeightsOpenOpen
Context window131K128K
Max output98K4K
Input $ / M tokens$0.20$0.10
Output $ / M tokens$1.10$0.30
Results tracked2743

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-4.5-Air leads

GLM-4.5-Air: 33.3 (#259), Llama 4 Scout: 20.2 (#339)

BenchmarkGLM-4.5-AirLlama 4 Scout
LMArena Coding13971286
SWE-bench Verified (bash only)—9.1%
SciCode—17%
GSO2.9%—
BigCodeBench Complete—43.1%

Agentic & Tool Use Not comparable

GLM-4.5-Air: —, Llama 4 Scout: 24.6 (#119)

BenchmarkGLM-4.5-AirLlama 4 Scout
Berkeley Function Calling Leaderboard—28.1%

Reasoning GLM-4.5-Air leads

GLM-4.5-Air: 24.1 (#166), Llama 4 Scout: 9.1 (#345)

BenchmarkGLM-4.5-AirLlama 4 Scout
Kagi LLM Benchmark43%36.9%
LMArena Hard Prompts13791266
ForecastBench59.257.5
ARC-AGI-2—0%
ARC-AGI-1—0.5%
CritPt—0%
DTBench—57.9%
LMCA—12%
Epoch Capabilities Index—129.64

Math GLM-4.5-Air leads

GLM-4.5-Air: 36.2 (#170), Llama 4 Scout: 19.6 (#286)

BenchmarkGLM-4.5-AirLlama 4 Scout
Omni-MATH39.1%37.3%
LMArena Math13961287
OTIS Mock AIME 2024-2025—7.8%
MATH Level 5—62.3%
FrontierMath (Feb 2025 set)—0%

Knowledge GLM-4.5-Air leads

GLM-4.5-Air: 35.0 (#191), Llama 4 Scout: 31.9 (#217)

BenchmarkGLM-4.5-AirLlama 4 Scout
MMLU-Pro76.2%74.2%
Vectara Hallucination Rate9.3%7.7%
GPQA (HELM)59.4%50.7%
LMArena Expert13701235
GPQA Diamond—51.8%
Humanity's Last Exam8.1%—

Multimodal Not comparable

GLM-4.5-Air: —, Llama 4 Scout: 32.2 (#102)

BenchmarkGLM-4.5-AirLlama 4 Scout
LMArena Vision—1118
SpatialViz-Bench—34.2%

Multilingual GLM-4.5-Air leads

GLM-4.5-Air: 49.1 (#135), Llama 4 Scout: 41.0 (#212)

BenchmarkGLM-4.5-AirLlama 4 Scout
LMArena Non-English13661252
LMArena Chinese14261255
LMArena French13991282
LMArena German13771272
LMArena Japanese13481206
LMArena Korean13081207
LMArena Russian13731263
LMArena Spanish13861278

Instruction Following GLM-4.5-Air leads

GLM-4.5-Air: 69.6 (#171), Llama 4 Scout: 65.8 (#217)

BenchmarkGLM-4.5-AirLlama 4 Scout
IFEval81.2%81.8%
LMArena Instruction Following13541248

Long Context GLM-4.5-Air leads

GLM-4.5-Air: 41.6 (#135), Llama 4 Scout: 27.5 (#294)

BenchmarkGLM-4.5-AirLlama 4 Scout
LMArena Longer Query13661265
Fiction.LiveBench—36%

Writing & Preference GLM-4.5-Air leads

GLM-4.5-Air: 55.9 (#139), Llama 4 Scout: 37.0 (#261)

BenchmarkGLM-4.5-AirLlama 4 Scout
LMArena Text13841279
LMArena Creative Writing13431249
WildBench78.9%78%
LMArena Multi-Turn13711280
EQ-Bench Creative Writing—783

Frequently asked questions

Is GLM-4.5-Air better than Llama 4 Scout?

GLM-4.5-Air is the stronger model overall, scoring 38.9 to 27.7 on the Noometry Index. Llama 4 Scout costs 2.8× less per token, which makes it the better buy when GLM-4.5-Air's lead doesn't matter for your workload.

Which is cheaper, GLM-4.5-Air or Llama 4 Scout?

Llama 4 Scout is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; GLM-4.5-Air lists at $0.20 and $1.10.

Is GLM-4.5-Air or Llama 4 Scout better for coding?

GLM-4.5-Air scores higher on coding benchmarks: 33.3 versus 20.2 in the Noometry coding category.

Which has the bigger context window?

GLM-4.5-Air does, with 131K tokens against 128K.

How many benchmarks do GLM-4.5-Air and Llama 4 Scout share?

25 benchmarks have published results for both models. GLM-4.5-Air has 27 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper