Model comparison

DeepSeek Coder 33B vs Sonar

Sonar has enough public results to be ranked (#184); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

DeepSeek Coder 33B DeepSeek

38.3

Unranked Sparse

Sonar Perplexity

37.8

Rank #184 Confirmed

Summary

  • DeepSeek Coder 33B has downloadable open weights; the other is API-only.

Side by side

DeepSeek Coder 33B and Sonar specifications
DeepSeek Coder 33BSonar
ProviderDeepSeekPerplexity
Noometry Index38.337.8
Released2023-11-022024-01-01
WeightsOpenProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked97

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek Coder 33B leads

DeepSeek Coder 33B: 37.4 (#180), Sonar: 35.1 (#217)

Coding benchmarks
BenchmarkDeepSeek Coder 33BSonar
BigCodeBench Instruct42%—
LiveBench Coding—35.1%
BigCodeBench Complete51.1%—
HumanEval+75%—
MBPP+70.1%—

Reasoning Not comparable

DeepSeek Coder 33B: —, Sonar: 20.3 (#221)

Reasoning benchmarks
BenchmarkDeepSeek Coder 33BSonar
LiveBench Reasoning—46.3%
LiveBench Data Analysis—37.9%
Epoch Capabilities Index95.74—
LiveBench—46.9%
WinoGrande62%—

Math Not comparable

DeepSeek Coder 33B: —, Sonar: 31.3 (#197)

Math benchmarks
BenchmarkDeepSeek Coder 33BSonar
LiveBench Math—41.6%
GSM8K35.4%—

Knowledge Not comparable

DeepSeek Coder 33B: —, Sonar: —

Knowledge benchmarks
BenchmarkDeepSeek Coder 33BSonar
ARC (AI2) Challenge42.2%—
MMLU39.4%—

Instruction Following Not comparable

DeepSeek Coder 33B: —, Sonar: 71.5 (#146)

Instruction Following benchmarks
BenchmarkDeepSeek Coder 33BSonar
LiveBench Instruction Following—76.2%

Writing & Preference Not comparable

DeepSeek Coder 33B: —, Sonar: 52.6 (#166)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 33BSonar
LiveBench Language—44.1%

Frequently asked questions

Is DeepSeek Coder 33B better than Sonar?

Sonar has enough public results to be ranked (#184); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 33B or Sonar better for coding?

DeepSeek Coder 33B scores higher on coding benchmarks: 37.4 versus 35.1 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 33B and Sonar share?

0 benchmarks have published results for both models. DeepSeek Coder 33B has 9 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper