Noometry

Model comparison

GLM-5.3-Flash vs Magistral Medium

GLM-5.3-Flash is the stronger model overall, scoring 51.8 to 35.2 on the Noometry Index.

Last verified . 21 shared benchmarks.

GLM-5.3-Flash Z.ai (Zhipu)

51.8

Rank #41 Confirmed

Magistral Medium Mistral AI

35.2

Rank #227 Confirmed

Summary

  • They share 21 benchmarks with published results for both. GLM-5.3-Flash scores higher in 8 categories and Magistral Medium in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GLM-5.3-Flash leads 48.0 to 8.6.
  • The biggest single-benchmark swing is ARC-AGI-1: 91% for GLM-5.3-Flash and 6.1% for Magistral Medium.
  • GLM-5.3-Flash is cheaper at $0.15 / $0.50 per million input/output tokens, against $2 / $5 for Magistral Medium.
  • GLM-5.3-Flash accepts more context: 1M tokens versus 262K.

Side by side

GLM-5.3-FlashMagistral Medium
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index51.835.2
Released2026-08-202025-03-17
WeightsOpenOpen
Context window1M262K
Max output131K16K
Input $ / M tokens$0.15$2
Output $ / M tokens$0.50$5
Results tracked4022

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.3-Flash leads

GLM-5.3-Flash: 53.1 (#31), Magistral Medium: 39.1 (#161)

BenchmarkGLM-5.3-FlashMagistral Medium
SciCode51.6%39.2%
LMArena Coding15081319
DeepSWE63.4%—
FrontierCode31.8%—
CursorBench36.8%—
LMArena WebDev1609—
FrontierSWE18.1%—
ALE-Bench303.55—

Agentic & Tool Use Not comparable

GLM-5.3-Flash: 34.2 (#47), Magistral Medium: —

BenchmarkGLM-5.3-FlashMagistral Medium
APEX-Agents52.8%—
GDP.pdf14%—

Reasoning GLM-5.3-Flash leads

GLM-5.3-Flash: 48.0 (#42), Magistral Medium: 8.6 (#348)

BenchmarkGLM-5.3-FlashMagistral Medium
ARC-AGI-265.8%0%
ARC-AGI-191%6.1%
CritPt15.4%0.3%
LMArena Hard Prompts14911267
Kagi LLM Benchmark—16.2%
Chess Puzzles14%—
Mystery Game Puzzles8%—
Surface Evolver Bench52.5%—
Bench to the Future 30.15—
Epoch Capabilities Index151.88—

Math GLM-5.3-Flash leads

GLM-5.3-Flash: 53.3 (#47), Magistral Medium: 35.1 (#189)

BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Math15001250
FrontierMath (Tiers 1-3)55.8%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202593.9%—
ProofBench21%—

Knowledge GLM-5.3-Flash leads

GLM-5.3-Flash: 58.4 (#36), Magistral Medium: 33.5 (#202)

BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Expert15131223
GPQA Diamond90.2%—

Multimodal Not comparable

GLM-5.3-Flash: 42.8 (#27), Magistral Medium: —

BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Vision1296—

Multilingual GLM-5.3-Flash leads

GLM-5.3-Flash: 56.0 (#25), Magistral Medium: 39.6 (#224)

BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Non-English14621232
LMArena Chinese15271227
LMArena French14961267
LMArena German14701248
LMArena Japanese14291175
LMArena Korean14461125
LMArena Russian14691224
LMArena Spanish14711271

Instruction Following GLM-5.3-Flash leads

GLM-5.3-Flash: 77.5 (#20), Magistral Medium: 66.0 (#211)

BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Instruction Following14781254

Long Context GLM-5.3-Flash leads

GLM-5.3-Flash: 45.4 (#39), Magistral Medium: 39.3 (#183)

BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Longer Query14821295

Writing & Preference GLM-5.3-Flash leads

GLM-5.3-Flash: 65.3 (#50), Magistral Medium: 46.3 (#219)

BenchmarkGLM-5.3-FlashMagistral Medium
LMArena Text14711255
LMArena Creative Writing14421245
LMArena Multi-Turn14671275

Frequently asked questions

Is GLM-5.3-Flash better than Magistral Medium?

GLM-5.3-Flash is the stronger model overall, scoring 51.8 to 35.2 on the Noometry Index.

Which is cheaper, GLM-5.3-Flash or Magistral Medium?

GLM-5.3-Flash is cheaper. It lists at $0.15 per million input tokens and $0.50 per million output tokens; Magistral Medium lists at $2 and $5.

Is GLM-5.3-Flash or Magistral Medium better for coding?

GLM-5.3-Flash scores higher on coding benchmarks: 53.1 versus 39.1 in the Noometry coding category.

Which has the bigger context window?

GLM-5.3-Flash does, with 1M tokens against 262K.

How many benchmarks do GLM-5.3-Flash and Magistral Medium share?

21 benchmarks have published results for both models. GLM-5.3-Flash has 40 scored results on Noometry and Magistral Medium has 22.

Related comparisons

Go deeper