Noometry

Model comparison

Claude Sonnet 4.6 vs Mercury

Claude Sonnet 4.6 is the stronger model overall, scoring 50.3 to 37.6 on the Noometry Index.

Last verified . 8 shared benchmarks.

Claude Sonnet 4.6 Anthropic

50.3

Rank #50 Confirmed

Mercury Inception

37.6

Rank #199 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Claude Sonnet 4.6 scores higher in 6 categories and Mercury in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Sonnet 4.6 leads 46.1 to 17.5.

Side by side

Claude Sonnet 4.6Mercury
ProviderAnthropicInception
Noometry Index50.337.6
Released2026-02-17—
WeightsProprietaryProprietary
Context window1M—
Max output128K—
Input $ / M tokens$3—
Output $ / M tokens$15—
Results tracked579

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 46.3 (#67), Mercury: 38.7 (#170)

BenchmarkClaude Sonnet 4.6Mercury
LMArena Coding15041322
SWE-bench Verified75.2%—
DeepSWE29.9%—
FrontierCode24.3%—
LMArena WebDev1522—
SciCode46.8%—
WeirdML66.1%—
ALE-Bench1,327—

Agentic & Tool Use Not comparable

Claude Sonnet 4.6: 39.1 (#28), Mercury: —

BenchmarkClaude Sonnet 4.6Mercury
Terminal-Bench53.4%—
APEX-Agents43%—
OSWorld 2.09.3%—
DeepResearch Bench54.9%—
OSWorld72.1%—
ExploitBench23.6%—
GBAEval48.8%—
GDP.pdf18%—
LMArena Search1221—
Vending-Bench 27,204—

Reasoning Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 46.1 (#45), Mercury: 17.5 (#293)

BenchmarkClaude Sonnet 4.6Mercury
LMArena Hard Prompts14841285
ARC-AGI-260.4%—
Kagi LLM Benchmark—21.6%
NYT Connections (extended)80.9%—
ARC-AGI-186.5%—
CritPt3.1%—
Chess Puzzles13%—
Thematic Generalization76.3%—
Mystery Game Puzzles16%—
DTBench89.9%—
LMCA46.5%—
Epoch Capabilities Index152.24—
ForecastBench62—

Math Not comparable

Claude Sonnet 4.6: 52.9 (#49), Mercury: —

BenchmarkClaude Sonnet 4.6Mercury
OTIS Mock AIME 2024-202585.8%—
ProofBench45%—
LMArena Math1462—
FrontierMath (Feb 2025 set)32.4%—
FrontierMath Tier 4 (v1)8.3%—

Knowledge Not comparable

Claude Sonnet 4.6: 51.7 (#65), Mercury: —

BenchmarkClaude Sonnet 4.6Mercury
GPQA Diamond87.4%—
SimpleQA Verified35.5%—
Vectara Hallucination Rate10.6%—
LMArena Expert1500—

Multimodal Not comparable

Claude Sonnet 4.6: 38.0 (#68), Mercury: —

BenchmarkClaude Sonnet 4.6Mercury
LMArena Vision1283—
Blueprint-Bench 26.7%—
LMArena Document1482—

Multilingual Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 54.4 (#41), Mercury: 41.6 (#206)

BenchmarkClaude Sonnet 4.6Mercury
LMArena Non-English14401260
LMArena Chinese1491—
LMArena French1465—
LMArena German1428—
LMArena Japanese1420—
LMArena Korean1411—
LMArena Russian1440—
LMArena Spanish1464—

Instruction Following Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 77.4 (#25), Mercury: 65.2 (#224)

BenchmarkClaude Sonnet 4.6Mercury
LMArena Instruction Following14751239

Long Context Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 45.3 (#44), Mercury: 38.4 (#198)

BenchmarkClaude Sonnet 4.6Mercury
LMArena Longer Query14791266

Writing & Preference Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 70.2 (#22), Mercury: 46.2 (#221)

BenchmarkClaude Sonnet 4.6Mercury
LMArena Text14581282
LMArena Creative Writing14351191
LMArena Multi-Turn14641282
EQ-Bench Creative Writing1810—
EQ-Bench 41207—

Frequently asked questions

Is Claude Sonnet 4.6 better than Mercury?

Claude Sonnet 4.6 is the stronger model overall, scoring 50.3 to 37.6 on the Noometry Index.

Is Claude Sonnet 4.6 or Mercury better for coding?

Claude Sonnet 4.6 scores higher on coding benchmarks: 46.3 versus 38.7 in the Noometry coding category.

How many benchmarks do Claude Sonnet 4.6 and Mercury share?

8 benchmarks have published results for both models. Claude Sonnet 4.6 has 57 scored results on Noometry and Mercury has 9.

Related comparisons

Go deeper