Model comparison

GPT-5.3 Chat vs Mercury 2

GPT-5.3 Chat is the stronger model overall, scoring 42.8 to 39.1 on the Noometry Index. Mercury 2 costs 13× less per token, which makes it the better buy when GPT-5.3 Chat's lead doesn't matter for your workload.

Last verified . 11 shared benchmarks.

GPT-5.3 Chat OpenAI

42.8

Rank #109 Confirmed

Mercury 2 Inception

39.1

Rank #175 Confirmed

Summary

  • They share 11 benchmarks with published results for both. GPT-5.3 Chat scores higher in 7 categories and Mercury 2 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GPT-5.3 Chat leads 63.1 to 53.8.
  • Mercury 2 is cheaper at $0.25 / $0.75 per million input/output tokens, against $1.75 / $14 for GPT-5.3 Chat.

Side by side

GPT-5.3 Chat and Mercury 2 specifications
GPT-5.3 ChatMercury 2
ProviderOpenAIInception
Noometry Index42.839.1
Released2026-03-032026-02-20
WeightsProprietaryProprietary
Context window128K128K
Max output16K50K
Input $ / M tokens$1.75$0.25
Output $ / M tokens$14$0.75
Results tracked1817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.3 Chat leads

GPT-5.3 Chat: 41.4 (#124), Mercury 2: 33.5 (#255)

Coding benchmarks
BenchmarkGPT-5.3 ChatMercury 2
LMArena Coding14081391
LMArena WebDev—1171
SciCode—38.7%
WeirdML—43.2%
ALE-Bench—785.58

Reasoning GPT-5.3 Chat leads

GPT-5.3 Chat: 28.5 (#102), Mercury 2: 23.8 (#170)

Reasoning benchmarks
BenchmarkGPT-5.3 ChatMercury 2
LMArena Hard Prompts13991362
CritPt—0.8%

Math Not comparable

GPT-5.3 Chat: 38.2 (#142), Mercury 2: —

Math benchmarks
BenchmarkGPT-5.3 ChatMercury 2
LMArena Math1389—

Knowledge GPT-5.3 Chat leads

GPT-5.3 Chat: 38.8 (#140), Mercury 2: 36.2 (#172)

Knowledge benchmarks
BenchmarkGPT-5.3 ChatMercury 2
LMArena Expert13971358
Vectara Hallucination Rate—12.3%

Multilingual GPT-5.3 Chat leads

GPT-5.3 Chat: 50.3 (#124), Mercury 2: 46.6 (#157)

Multilingual benchmarks
BenchmarkGPT-5.3 ChatMercury 2
LMArena Non-English13821331
LMArena Chinese14321417
LMArena Russian14001304
LMArena French1397—
LMArena German1384—
LMArena Japanese1352—
LMArena Korean1346—
LMArena Spanish1371—

Instruction Following GPT-5.3 Chat leads

GPT-5.3 Chat: 72.8 (#129), Mercury 2: 70.2 (#165)

Instruction Following benchmarks
BenchmarkGPT-5.3 ChatMercury 2
LMArena Instruction Following13781329

Long Context GPT-5.3 Chat leads

GPT-5.3 Chat: 42.6 (#120), Mercury 2: 40.5 (#154)

Long Context benchmarks
BenchmarkGPT-5.3 ChatMercury 2
LMArena Longer Query13961330

Writing & Preference GPT-5.3 Chat leads

GPT-5.3 Chat: 63.1 (#68), Mercury 2: 53.8 (#155)

Writing & Preference benchmarks
BenchmarkGPT-5.3 ChatMercury 2
LMArena Text13891355
LMArena Creative Writing13551289
LMArena Multi-Turn14121358
EQ-Bench Creative Writing1690—

Frequently asked questions

Is GPT-5.3 Chat better than Mercury 2?

GPT-5.3 Chat is the stronger model overall, scoring 42.8 to 39.1 on the Noometry Index. Mercury 2 costs 13× less per token, which makes it the better buy when GPT-5.3 Chat's lead doesn't matter for your workload.

Which is cheaper, GPT-5.3 Chat or Mercury 2?

Mercury 2 is cheaper. It lists at $0.25 per million input tokens and $0.75 per million output tokens; GPT-5.3 Chat lists at $1.75 and $14.

Is GPT-5.3 Chat or Mercury 2 better for coding?

GPT-5.3 Chat scores higher on coding benchmarks: 41.4 versus 33.5 in the Noometry coding category.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do GPT-5.3 Chat and Mercury 2 share?

11 benchmarks have published results for both models. GPT-5.3 Chat has 18 scored results on Noometry and Mercury 2 has 17.

Related comparisons

Go deeper