Model comparison

DeepSeek Coder 6.7B vs Mercury 2.5

Neither DeepSeek Coder 6.7B nor Mercury 2.5 has enough public benchmark results to be ranked yet; the rows below show what has been published.

Last verified . 0 shared benchmarks.

DeepSeek Coder 6.7B DeepSeek

37.1

Unranked Sparse

Mercury 2.5 Inception

30.2

Unranked Sparse

Summary

  • DeepSeek Coder 6.7B has downloadable open weights; the other is API-only.

Side by side

DeepSeek Coder 6.7B and Mercury 2.5 specifications
DeepSeek Coder 6.7BMercury 2.5
ProviderDeepSeekInception
Noometry Index37.130.2
Released2023-11-022026-09-08
WeightsOpenProprietary
Context window—260K
Max output—66K
Input $ / M tokens—$0.04
Output $ / M tokens—$0.15
Results tracked92

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DeepSeek Coder 6.7B: 35.2 (#216), Mercury 2.5: —

Coding benchmarks
BenchmarkDeepSeek Coder 6.7BMercury 2.5
BigCodeBench Instruct35.5%—
BigCodeBench Complete43.8%—
ALE-Bench—301.65
HumanEval+71.3%—
MBPP+65.6%—

Reasoning Not comparable

DeepSeek Coder 6.7B: —, Mercury 2.5: —

Reasoning benchmarks
BenchmarkDeepSeek Coder 6.7BMercury 2.5
Epoch Capabilities Index88.88—
WinoGrande57.6%—

Math Not comparable

DeepSeek Coder 6.7B: —, Mercury 2.5: 22.4

Math benchmarks
BenchmarkDeepSeek Coder 6.7BMercury 2.5
ProofBench—3%
GSM8K21.3%—

Knowledge Not comparable

DeepSeek Coder 6.7B: —, Mercury 2.5: —

Knowledge benchmarks
BenchmarkDeepSeek Coder 6.7BMercury 2.5
ARC (AI2) Challenge36.4%—
MMLU36.4%—

Frequently asked questions

Is DeepSeek Coder 6.7B better than Mercury 2.5?

Neither DeepSeek Coder 6.7B nor Mercury 2.5 has enough public benchmark results to be ranked yet; the rows below show what has been published.

How many benchmarks do DeepSeek Coder 6.7B and Mercury 2.5 share?

0 benchmarks have published results for both models. DeepSeek Coder 6.7B has 9 scored results on Noometry and Mercury 2.5 has 2.

Related comparisons

Go deeper