Model comparison

DeepSeek Coder 33B vs Wizardlm 70b

Wizardlm 70b has enough public results to be ranked (#245); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

DeepSeek Coder 33B DeepSeek

38.3

Unranked Sparse

Wizardlm 70b Microsoft

32.4

Rank #245 Confirmed

Summary

  • The widest gap is in coding, where DeepSeek Coder 33B leads 37.4 to 30.9.

Side by side

DeepSeek Coder 33B and Wizardlm 70b specifications
DeepSeek Coder 33BWizardlm 70b
ProviderDeepSeekMicrosoft
Noometry Index38.332.4
Released2023-11-02—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked912

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek Coder 33B leads

DeepSeek Coder 33B: 37.4 (#180), Wizardlm 70b: 30.9 (#280)

Coding benchmarks
BenchmarkDeepSeek Coder 33BWizardlm 70b
BigCodeBench Instruct42%—
LMArena Coding—1081
BigCodeBench Complete51.1%—
HumanEval+75%—
MBPP+70.1%—

Reasoning Not comparable

DeepSeek Coder 33B: —, Wizardlm 70b: 19.8 (#231)

Reasoning benchmarks
BenchmarkDeepSeek Coder 33BWizardlm 70b
LMArena Hard Prompts—1079
Epoch Capabilities Index95.74—
WinoGrande62%—

Math Not comparable

DeepSeek Coder 33B: —, Wizardlm 70b: 29.7 (#216)

Math benchmarks
BenchmarkDeepSeek Coder 33BWizardlm 70b
LMArena Math—1116
GSM8K35.4%—

Knowledge Not comparable

DeepSeek Coder 33B: —, Wizardlm 70b: —

Knowledge benchmarks
BenchmarkDeepSeek Coder 33BWizardlm 70b
ARC (AI2) Challenge42.2%—
MMLU39.4%—

Multilingual Not comparable

DeepSeek Coder 33B: —, Wizardlm 70b: 29.8 (#260)

Multilingual benchmarks
BenchmarkDeepSeek Coder 33BWizardlm 70b
LMArena Non-English—1078
LMArena Chinese—1052
LMArena German—1083
LMArena Russian—1155

Instruction Following Not comparable

DeepSeek Coder 33B: —, Wizardlm 70b: 56.5 (#268)

Instruction Following benchmarks
BenchmarkDeepSeek Coder 33BWizardlm 70b
LMArena Instruction Following—1093

Long Context Not comparable

DeepSeek Coder 33B: —, Wizardlm 70b: 33.3 (#258)

Long Context benchmarks
BenchmarkDeepSeek Coder 33BWizardlm 70b
LMArena Longer Query—1097

Writing & Preference Not comparable

DeepSeek Coder 33B: —, Wizardlm 70b: 34.9 (#264)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 33BWizardlm 70b
LMArena Text—1120
LMArena Creative Writing—1149
LMArena Multi-Turn—1108

Frequently asked questions

Is DeepSeek Coder 33B better than Wizardlm 70b?

Wizardlm 70b has enough public results to be ranked (#245); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 33B or Wizardlm 70b better for coding?

DeepSeek Coder 33B scores higher on coding benchmarks: 37.4 versus 30.9 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 33B and Wizardlm 70b share?

0 benchmarks have published results for both models. DeepSeek Coder 33B has 9 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper