Model comparison

DeepSeek Coder 1.3B vs Mercury 2.5

Mercury 2.5 has enough public results to be ranked (#242); DeepSeek Coder 1.3B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

DeepSeek Coder 1.3B DeepSeek

35.0

Unranked Sparse

Mercury 2.5 Inception

33.5

Rank #242 Reported

Summary

  • The widest gap is in coding, where Mercury 2.5 leads 39.5 to 31.2.
  • DeepSeek Coder 1.3B has downloadable open weights; the other is API-only.

Side by side

DeepSeek Coder 1.3B and Mercury 2.5 specifications
DeepSeek Coder 1.3BMercury 2.5
ProviderDeepSeekInception
Noometry Index35.033.5
Released2023-11-022026-09-08
WeightsOpenProprietary
Context window—260K
Max output—66K
Input $ / M tokens—$0.04
Output $ / M tokens—$0.15
Results tracked94

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mercury 2.5 leads

DeepSeek Coder 1.3B: 31.2 (#287), Mercury 2.5: 39.5 (#156)

Coding benchmarks
BenchmarkDeepSeek Coder 1.3BMercury 2.5
SciCode—38.5%
BigCodeBench Instruct22.8%—
BigCodeBench Complete29.6%—
ALE-Bench—301.65
HumanEval+60.4%—
MBPP+54.8%—

Reasoning Not comparable

DeepSeek Coder 1.3B: —, Mercury 2.5: 22.4 (#193)

Reasoning benchmarks
BenchmarkDeepSeek Coder 1.3BMercury 2.5
CritPt—0%
Epoch Capabilities Index63.6—
WinoGrande53.3%—

Math Not comparable

DeepSeek Coder 1.3B: —, Mercury 2.5: 23.3 (#272)

Math benchmarks
BenchmarkDeepSeek Coder 1.3BMercury 2.5
ProofBench—3%
GSM8K4.4%—

Knowledge Not comparable

DeepSeek Coder 1.3B: —, Mercury 2.5: —

Knowledge benchmarks
BenchmarkDeepSeek Coder 1.3BMercury 2.5
ARC (AI2) Challenge25.4%—
MMLU25.8%—

Frequently asked questions

Is DeepSeek Coder 1.3B better than Mercury 2.5?

Mercury 2.5 has enough public results to be ranked (#242); DeepSeek Coder 1.3B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 1.3B or Mercury 2.5 better for coding?

Mercury 2.5 scores higher on coding benchmarks: 39.5 versus 31.2 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 1.3B and Mercury 2.5 share?

0 benchmarks have published results for both models. DeepSeek Coder 1.3B has 9 scored results on Noometry and Mercury 2.5 has 4.

Related comparisons

Go deeper