Noometry

Model comparison

GLM-5.3-Flash vs Mercury 2

GLM-5.3-Flash is the stronger model overall, scoring 51.8 to 39.1 on the Noometry Index.

Last verified . 15 shared benchmarks.

GLM-5.3-Flash Z.ai (Zhipu)

51.8

Rank #41 Confirmed

Mercury 2 Inception

39.1

Rank #175 Confirmed

Summary

  • They share 15 benchmarks with published results for both. GLM-5.3-Flash scores higher in 7 categories and Mercury 2 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GLM-5.3-Flash leads 48.0 to 23.8.
  • The biggest single-benchmark swing is CritPt: 15.4% for GLM-5.3-Flash and 0.8% for Mercury 2.
  • GLM-5.3-Flash is cheaper at $0.15 / $0.50 per million input/output tokens, against $0.25 / $0.75 for Mercury 2.
  • GLM-5.3-Flash accepts more context: 1M tokens versus 128K.
  • GLM-5.3-Flash has downloadable open weights; the other is API-only.

Side by side

GLM-5.3-FlashMercury 2
ProviderZ.ai (Zhipu)Inception
Noometry Index51.839.1
Released2026-08-202026-02-20
WeightsOpenProprietary
Context window1M128K
Max output131K50K
Input $ / M tokens$0.15$0.25
Output $ / M tokens$0.50$0.75
Results tracked4017

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GLM-5.3-Flash leads

GLM-5.3-Flash: 53.1 (#31), Mercury 2: 33.5 (#255)

BenchmarkGLM-5.3-FlashMercury 2
LMArena WebDev16091171
SciCode51.6%38.7%
LMArena Coding15081391
ALE-Bench303.55785.58
DeepSWE63.4%—
FrontierCode31.8%—
CursorBench36.8%—
FrontierSWE18.1%—
WeirdML—43.2%

Agentic & Tool Use Not comparable

GLM-5.3-Flash: 34.2 (#47), Mercury 2: —

BenchmarkGLM-5.3-FlashMercury 2
APEX-Agents52.8%—
GDP.pdf14%—

Reasoning GLM-5.3-Flash leads

GLM-5.3-Flash: 48.0 (#42), Mercury 2: 23.8 (#170)

BenchmarkGLM-5.3-FlashMercury 2
CritPt15.4%0.8%
LMArena Hard Prompts14911362
ARC-AGI-265.8%—
ARC-AGI-191%—
Chess Puzzles14%—
Mystery Game Puzzles8%—
Surface Evolver Bench52.5%—
Bench to the Future 30.15—
Epoch Capabilities Index151.88—

Math Not comparable

GLM-5.3-Flash: 53.3 (#47), Mercury 2: —

BenchmarkGLM-5.3-FlashMercury 2
FrontierMath (Tiers 1-3)55.8%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202593.9%—
ProofBench21%—
LMArena Math1500—

Knowledge GLM-5.3-Flash leads

GLM-5.3-Flash: 58.4 (#36), Mercury 2: 36.2 (#172)

BenchmarkGLM-5.3-FlashMercury 2
LMArena Expert15131358
GPQA Diamond90.2%—
Vectara Hallucination Rate—12.3%

Multimodal Not comparable

GLM-5.3-Flash: 42.8 (#27), Mercury 2: —

BenchmarkGLM-5.3-FlashMercury 2
LMArena Vision1296—

Multilingual GLM-5.3-Flash leads

GLM-5.3-Flash: 56.0 (#25), Mercury 2: 46.6 (#157)

BenchmarkGLM-5.3-FlashMercury 2
LMArena Non-English14621331
LMArena Chinese15271417
LMArena Russian14691304
LMArena French1496—
LMArena German1470—
LMArena Japanese1429—
LMArena Korean1446—
LMArena Spanish1471—

Instruction Following GLM-5.3-Flash leads

GLM-5.3-Flash: 77.5 (#20), Mercury 2: 70.2 (#165)

BenchmarkGLM-5.3-FlashMercury 2
LMArena Instruction Following14781329

Long Context GLM-5.3-Flash leads

GLM-5.3-Flash: 45.4 (#39), Mercury 2: 40.5 (#154)

BenchmarkGLM-5.3-FlashMercury 2
LMArena Longer Query14821330

Writing & Preference GLM-5.3-Flash leads

GLM-5.3-Flash: 65.3 (#50), Mercury 2: 53.8 (#155)

BenchmarkGLM-5.3-FlashMercury 2
LMArena Text14711355
LMArena Creative Writing14421289
LMArena Multi-Turn14671358

Frequently asked questions

Is GLM-5.3-Flash better than Mercury 2?

GLM-5.3-Flash is the stronger model overall, scoring 51.8 to 39.1 on the Noometry Index.

Which is cheaper, GLM-5.3-Flash or Mercury 2?

GLM-5.3-Flash is cheaper. It lists at $0.15 per million input tokens and $0.50 per million output tokens; Mercury 2 lists at $0.25 and $0.75.

Is GLM-5.3-Flash or Mercury 2 better for coding?

GLM-5.3-Flash scores higher on coding benchmarks: 53.1 versus 33.5 in the Noometry coding category.

Which has the bigger context window?

GLM-5.3-Flash does, with 1M tokens against 128K.

How many benchmarks do GLM-5.3-Flash and Mercury 2 share?

15 benchmarks have published results for both models. GLM-5.3-Flash has 40 scored results on Noometry and Mercury 2 has 17.

Related comparisons

Go deeper