Model comparison

DeepSeek-V3 vs Mercury 2.5

DeepSeek-V3 is the stronger model overall, scoring 39.5 to 33.5 on the Noometry Index. Mercury 2.5 costs 6.0× less per token, which makes it the better buy when DeepSeek-V3's lead doesn't matter for your workload.

Last verified . 2 shared benchmarks.

DeepSeek-V3 DeepSeek

39.5

Rank #166 Confirmed

Mercury 2.5 Inception

33.5

Rank #242 Reported

Summary

  • They share 2 benchmarks with published results for both. DeepSeek-V3 scores higher in 2 categories and Mercury 2.5 in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek-V3 leads 32.1 to 23.3.
  • Mercury 2.5 is cheaper at $0.04 / $0.15 per million input/output tokens, against $0.24 / $0.90 for DeepSeek-V3.
  • Mercury 2.5 accepts more context: 260K tokens versus 164K.
  • DeepSeek-V3 has downloadable open weights; the other is API-only.

Side by side

DeepSeek-V3 and Mercury 2.5 specifications
DeepSeek-V3Mercury 2.5
ProviderDeepSeekInception
Noometry Index39.533.5
Released2024-12-262026-09-08
WeightsOpenProprietary
Context window164K260K
Max output164K66K
Input $ / M tokens$0.24$0.04
Output $ / M tokens$0.90$0.15
Results tracked604

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-V3 leads

DeepSeek-V3: 42.3 (#106), Mercury 2.5: 39.5 (#156)

Coding benchmarks
BenchmarkDeepSeek-V3Mercury 2.5
SciCode35.8%38.5%
Aider Polyglot55.1%—
WeirdML36.1%—
BigCodeBench Instruct50%—
LiveBench Coding70.9%—
LMArena Coding1368—
BigCodeBench Complete62.2%—
ALE-Bench—301.65
HumanEval+86.6%—
MBPP+73%—

Agentic & Tool Use Not comparable

DeepSeek-V3: —, Mercury 2.5: —

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V3Mercury 2.5
METR Time Horizons49.6%—

Reasoning Mercury 2.5 leads

DeepSeek-V3: 20.5 (#236), Mercury 2.5: 22.4 (#193)

Reasoning benchmarks
BenchmarkDeepSeek-V3Mercury 2.5
CritPt0%0%
SimpleBench27.2%—
Kagi LLM Benchmark52.3%—
LiveBench Reasoning65.8%—
LMArena Hard Prompts1365—
DTBench64.8%—
LiveBench Data Analysis60.9%—
LMCA15.5%—
BIG-Bench Hard87.5%—
Epoch Capabilities Index135.94—
ForecastBench59.1—
HellaSwag88.9%—
LiveBench66.9%—
PIQA84.7%—
WinoGrande85.2%—

Math DeepSeek-V3 leads

DeepSeek-V3: 32.1 (#219), Mercury 2.5: 23.3 (#272)

Math benchmarks
BenchmarkDeepSeek-V3Mercury 2.5
OTIS Mock AIME 2024-202537.8%—
ProofBench—3%
Omni-MATH40.3%—
LiveBench Math73.5%—
LMArena Math1373—
MATH Level 575.5%—
FrontierMath (Feb 2025 set)1.7%—

Knowledge Not comparable

DeepSeek-V3: 37.5 (#155), Mercury 2.5: —

Knowledge benchmarks
BenchmarkDeepSeek-V3Mercury 2.5
GPQA Diamond67.6%—
MMLU-Pro72.3%—
Confabulations26.1%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)53.8%—
LMArena Expert1351—
ARC (AI2) Challenge95.3%—
MMLU87.2%—
TriviaQA82.9%—

Multilingual Not comparable

DeepSeek-V3: 48.5 (#143), Mercury 2.5: —

Multilingual benchmarks
BenchmarkDeepSeek-V3Mercury 2.5
LMArena Non-English1358—
LMArena Chinese1391—
LMArena French1385—
LMArena German1374—
LMArena Japanese1333—
LMArena Korean1319—
LMArena Russian1373—
LMArena Spanish1358—

Instruction Following Not comparable

DeepSeek-V3: 72.8 (#130), Mercury 2.5: —

Instruction Following benchmarks
BenchmarkDeepSeek-V3Mercury 2.5
LiveBench Instruction Following81.5%—
IFEval83.2%—
LMArena Instruction Following1345—

Long Context Not comparable

DeepSeek-V3: 34.0 (#253), Mercury 2.5: —

Long Context benchmarks
BenchmarkDeepSeek-V3Mercury 2.5
Fiction.LiveBench50%—
LMArena Longer Query1352—

Writing & Preference Not comparable

DeepSeek-V3: 57.4 (#130), Mercury 2.5: —

Writing & Preference benchmarks
BenchmarkDeepSeek-V3Mercury 2.5
LMArena Text1375—
LMArena Creative Writing1364—
Short-Story Creative Writing77%—
EQ-Bench Creative Writing1472—
WildBench83%—
LMArena Multi-Turn1389—
LiveBench Language49.1%—

Frequently asked questions

Is DeepSeek-V3 better than Mercury 2.5?

DeepSeek-V3 is the stronger model overall, scoring 39.5 to 33.5 on the Noometry Index. Mercury 2.5 costs 6.0× less per token, which makes it the better buy when DeepSeek-V3's lead doesn't matter for your workload.

Which is cheaper, DeepSeek-V3 or Mercury 2.5?

Mercury 2.5 is cheaper. It lists at $0.04 per million input tokens and $0.15 per million output tokens; DeepSeek-V3 lists at $0.24 and $0.90.

Is DeepSeek-V3 or Mercury 2.5 better for coding?

DeepSeek-V3 scores higher on coding benchmarks: 42.3 versus 39.5 in the Noometry coding category.

Which has the bigger context window?

Mercury 2.5 does, with 260K tokens against 164K.

How many benchmarks do DeepSeek-V3 and Mercury 2.5 share?

2 benchmarks have published results for both models. DeepSeek-V3 has 60 scored results on Noometry and Mercury 2.5 has 4.

Related comparisons

Go deeper