Noometry

Model comparison

Claude Opus 4.1 vs Mercury

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 37.6 on the Noometry Index.

Last verified . 8 shared benchmarks.

Claude Opus 4.1 Anthropic

41.0

Rank #142 Confirmed

Mercury Inception

37.6

Rank #199 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Claude Opus 4.1 scores higher in 6 categories and Mercury in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Claude Opus 4.1 leads 62.4 to 46.2.

Side by side

Claude Opus 4.1Mercury
ProviderAnthropicInception
Noometry Index41.037.6
Released2025-08-05—
WeightsProprietaryProprietary
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked489

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.1 leads

Claude Opus 4.1: 44.4 (#73), Mercury: 38.7 (#170)

BenchmarkClaude Opus 4.1Mercury
LMArena Coding14791322
SWE-bench Verified73.3%—
LMArena WebDev1390—
WeirdML45.9%—
ALE-Bench674.77—
AlgoTune1.34—

Agentic & Tool Use Not comparable

Claude Opus 4.1: 35.0 (#41), Mercury: —

BenchmarkClaude Opus 4.1Mercury
Terminal-Bench38%—
GDPval43.6%—
Cybench42%—
DeepResearch Bench48.3%—
LMArena Search1148—
METR Time Horizons66.8%—

Reasoning Claude Opus 4.1 leads

Claude Opus 4.1: 32.2 (#76), Mercury: 17.5 (#293)

BenchmarkClaude Opus 4.1Mercury
LMArena Hard Prompts14431285
SimpleBench60%—
Kagi LLM Benchmark—21.6%
Chess Puzzles7%—
EnigmaEval7.2%—
EBR-Bench7.9%—
Mystery Game Puzzles21%—
DTBench80%—
LMCA37.1%—
Epoch Capabilities Index144.12—
ForecastBench62—

Math Not comparable

Claude Opus 4.1: 22.3 (#277), Mercury: —

BenchmarkClaude Opus 4.1Mercury
FrontierMath (Tiers 1-3)12.6%—
FrontierMath Tier 42.4%—
OTIS Mock AIME 2024-202568.9%—
LMArena Math1431—
FrontierMath (Feb 2025 set)7.2%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Not comparable

Claude Opus 4.1: 42.0 (#101), Mercury: —

BenchmarkClaude Opus 4.1Mercury
GPQA Diamond77.3%—
Humanity's Last Exam11.5%—
Confabulations17.1%—
Vectara Hallucination Rate11.8%—
LMArena Expert1439—

Multimodal Not comparable

Claude Opus 4.1: 26.8 (#119), Mercury: —

BenchmarkClaude Opus 4.1Mercury
VPCT35%—

Multilingual Claude Opus 4.1 leads

Claude Opus 4.1: 52.0 (#95), Mercury: 41.6 (#206)

BenchmarkClaude Opus 4.1Mercury
LMArena Non-English14051260
LMArena Chinese1427—
LMArena French1431—
LMArena German1413—
LMArena Japanese1378—
LMArena Korean1380—
LMArena Russian1422—
LMArena Spanish1448—

Instruction Following Claude Opus 4.1 leads

Claude Opus 4.1: 75.6 (#58), Mercury: 65.2 (#224)

BenchmarkClaude Opus 4.1Mercury
LMArena Instruction Following14351239

Long Context Claude Opus 4.1 leads

Claude Opus 4.1: 44.5 (#63), Mercury: 38.4 (#198)

BenchmarkClaude Opus 4.1Mercury
LMArena Longer Query14551266

Writing & Preference Claude Opus 4.1 leads

Claude Opus 4.1: 62.4 (#74), Mercury: 46.2 (#221)

BenchmarkClaude Opus 4.1Mercury
LMArena Text14191282
LMArena Creative Writing14121191
LMArena Multi-Turn14441282
Short-Story Creative Writing84.7%—

Frequently asked questions

Is Claude Opus 4.1 better than Mercury?

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 37.6 on the Noometry Index.

Is Claude Opus 4.1 or Mercury better for coding?

Claude Opus 4.1 scores higher on coding benchmarks: 44.4 versus 38.7 in the Noometry coding category.

How many benchmarks do Claude Opus 4.1 and Mercury share?

8 benchmarks have published results for both models. Claude Opus 4.1 has 48 scored results on Noometry and Mercury has 9.

Related comparisons

Go deeper