Noometry

Model comparison

GLM-5.3-Flash vs Mistral Medium

GLM-5.3-Flash is the stronger model overall, scoring 51.8 to 36.3 on the Noometry Index.

Last verified . 26 shared benchmarks.

GLM-5.3-Flash Z.ai (Zhipu)

51.8

Rank #41 Confirmed

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Summary

  • They share 26 benchmarks with published results for both. GLM-5.3-Flash scores higher in 10 categories and Mistral Medium in 0 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GLM-5.3-Flash leads 58.4 to 25.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 93.9% for GLM-5.3-Flash and 32.2% for Mistral Medium.
  • GLM-5.3-Flash is cheaper at $0.15 / $0.50 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium.
  • GLM-5.3-Flash accepts more context: 1M tokens versus 262K.

Side by side

GLM-5.3-FlashMistral Medium
ProviderZ.ai (Zhipu)Mistral AI
Noometry Index51.836.3
Released2026-08-202023-12-11
WeightsOpenOpen
Context window1M262K
Max output131K262K
Input $ / M tokens$0.15$1.50
Output $ / M tokens$0.50$7.50
Results tracked4036

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.3-Flash leads

GLM-5.3-Flash: 53.1 (#31), Mistral Medium: 34.2 (#243)

BenchmarkGLM-5.3-FlashMistral Medium
FrontierCode31.8%8%
SciCode51.6%40.2%
LMArena Coding15081434
ALE-Bench303.55763.98
DeepSWE63.4%—
CursorBench36.8%—
LMArena WebDev1609—
FrontierSWE18.1%—
WeirdML—43.7%

Agentic & Tool Use GLM-5.3-Flash leads

GLM-5.3-Flash: 34.2 (#47), Mistral Medium: 28.3 (#90)

BenchmarkGLM-5.3-FlashMistral Medium
APEX-Agents52.8%—
Berkeley Function Calling Leaderboard—37.7%
GDP.pdf14%—

Reasoning GLM-5.3-Flash leads

GLM-5.3-Flash: 48.0 (#42), Mistral Medium: 24.0 (#167)

BenchmarkGLM-5.3-FlashMistral Medium
CritPt15.4%0%
LMArena Hard Prompts14911426
Surface Evolver Bench52.5%26.9%
ARC-AGI-265.8%—
Kagi LLM Benchmark—50%
ARC-AGI-191%—
Chess Puzzles14%—
Mystery Game Puzzles8%—
DTBench—75.5%
LMCA—26.1%
Bench to the Future 30.15—
Epoch Capabilities Index151.88—

Math GLM-5.3-Flash leads

GLM-5.3-Flash: 53.3 (#47), Mistral Medium: 28.1 (#245)

BenchmarkGLM-5.3-FlashMistral Medium
OTIS Mock AIME 2024-202593.9%32.2%
ProofBench21%9%
LMArena Math15001408
FrontierMath (Tiers 1-3)55.8%—
FrontierMath Tier 417.1%—
MATH Level 5—81.6%
FrontierMath (Feb 2025 set)—0.3%

Knowledge GLM-5.3-Flash leads

GLM-5.3-Flash: 58.4 (#36), Mistral Medium: 25.0 (#265)

BenchmarkGLM-5.3-FlashMistral Medium
GPQA Diamond90.2%59.5%
LMArena Expert15131408
Humanity's Last Exam—4.5%
Vectara Hallucination Rate—22.7%

Multimodal GLM-5.3-Flash leads

GLM-5.3-Flash: 42.8 (#27), Mistral Medium: 35.3 (#88)

BenchmarkGLM-5.3-FlashMistral Medium
LMArena Vision12961172

Multilingual GLM-5.3-Flash leads

GLM-5.3-Flash: 56.0 (#25), Mistral Medium: 52.1 (#91)

BenchmarkGLM-5.3-FlashMistral Medium
LMArena Non-English14621408
LMArena Chinese15271447
LMArena French14961459
LMArena German14701432
LMArena Japanese14291378
LMArena Korean14461380
LMArena Russian14691411
LMArena Spanish14711433

Instruction Following GLM-5.3-Flash leads

GLM-5.3-Flash: 77.5 (#20), Mistral Medium: 73.7 (#116)

BenchmarkGLM-5.3-FlashMistral Medium
LMArena Instruction Following14781398

Long Context GLM-5.3-Flash leads

GLM-5.3-Flash: 45.4 (#39), Mistral Medium: 42.9 (#114)

BenchmarkGLM-5.3-FlashMistral Medium
LMArena Longer Query14821406

Writing & Preference GLM-5.3-Flash leads

GLM-5.3-Flash: 65.3 (#50), Mistral Medium: 60.0 (#103)

BenchmarkGLM-5.3-FlashMistral Medium
LMArena Text14711424
LMArena Creative Writing14421391
LMArena Multi-Turn14671418
Short-Story Creative Writing—77.3%

Frequently asked questions

Is GLM-5.3-Flash better than Mistral Medium?

GLM-5.3-Flash is the stronger model overall, scoring 51.8 to 36.3 on the Noometry Index.

Which is cheaper, GLM-5.3-Flash or Mistral Medium?

GLM-5.3-Flash is cheaper. It lists at $0.15 per million input tokens and $0.50 per million output tokens; Mistral Medium lists at $1.50 and $7.50.

Is GLM-5.3-Flash or Mistral Medium better for coding?

GLM-5.3-Flash scores higher on coding benchmarks: 53.1 versus 34.2 in the Noometry coding category.

Which has the bigger context window?

GLM-5.3-Flash does, with 1M tokens against 262K.

How many benchmarks do GLM-5.3-Flash and Mistral Medium share?

26 benchmarks have published results for both models. GLM-5.3-Flash has 40 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper