Model comparison

DeepSeek Coder 1.3B vs Wizardlm 13b

Wizardlm 13b has enough public results to be ranked (#274); DeepSeek Coder 1.3B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

DeepSeek Coder 1.3B DeepSeek

35.0

Unranked Sparse

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Side by side

DeepSeek Coder 1.3B and Wizardlm 13b specifications
DeepSeek Coder 1.3BWizardlm 13b
ProviderDeepSeekMicrosoft
Noometry Index35.031.4
Released2023-11-02—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked910

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek Coder 1.3B leads

DeepSeek Coder 1.3B: 31.2 (#287), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkDeepSeek Coder 1.3BWizardlm 13b
BigCodeBench Instruct22.8%—
LMArena Coding—1035
BigCodeBench Complete29.6%—
HumanEval+60.4%—
MBPP+54.8%—

Reasoning Not comparable

DeepSeek Coder 1.3B: —, Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkDeepSeek Coder 1.3BWizardlm 13b
LMArena Hard Prompts—1018
Epoch Capabilities Index63.6—
WinoGrande53.3%—

Math Not comparable

DeepSeek Coder 1.3B: —, Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkDeepSeek Coder 1.3BWizardlm 13b
LMArena Math—1017
GSM8K4.4%—

Knowledge Not comparable

DeepSeek Coder 1.3B: —, Wizardlm 13b: —

Knowledge benchmarks
BenchmarkDeepSeek Coder 1.3BWizardlm 13b
ARC (AI2) Challenge25.4%—
MMLU25.8%—

Multilingual Not comparable

DeepSeek Coder 1.3B: —, Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkDeepSeek Coder 1.3BWizardlm 13b
LMArena Non-English—1034
LMArena Chinese—1023

Instruction Following Not comparable

DeepSeek Coder 1.3B: —, Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkDeepSeek Coder 1.3BWizardlm 13b
LMArena Instruction Following—1048

Long Context Not comparable

DeepSeek Coder 1.3B: —, Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkDeepSeek Coder 1.3BWizardlm 13b
LMArena Longer Query—1054

Writing & Preference Not comparable

DeepSeek Coder 1.3B: —, Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 1.3BWizardlm 13b
LMArena Text—1077
LMArena Creative Writing—1091
LMArena Multi-Turn—1047

Frequently asked questions

Is DeepSeek Coder 1.3B better than Wizardlm 13b?

Wizardlm 13b has enough public results to be ranked (#274); DeepSeek Coder 1.3B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 1.3B or Wizardlm 13b better for coding?

DeepSeek Coder 1.3B scores higher on coding benchmarks: 31.2 versus 30.1 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 1.3B and Wizardlm 13b share?

0 benchmarks have published results for both models. DeepSeek Coder 1.3B has 9 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper