Model comparison

DeepSeek Coder 1.3B vs OLMo 2 Furious 13B

OLMo 2 Furious 13B has enough public results to be ranked (#301); DeepSeek Coder 1.3B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Side by side

DeepSeek Coder 1.3B and OLMo 2 Furious 13B specifications
DeepSeek Coder 1.3BOLMo 2 Furious 13B
ProviderDeepSeekAllen Institute for AI (Ai2)
Noometry Index34.529.2
Released2023-11-022024-12-31
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked912

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek Coder 1.3B leads

DeepSeek Coder 1.3B: 30.7 (#282), OLMo 2 Furious 13B: 28.1 (#309)

Coding benchmarks
BenchmarkDeepSeek Coder 1.3BOLMo 2 Furious 13B
BigCodeBench Instruct22.8%—
LiveBench Coding—10.4%
BigCodeBench Complete29.6%—
HumanEval+60.4%—
MBPP+54.8%—

Reasoning Not comparable

DeepSeek Coder 1.3B: —, OLMo 2 Furious 13B: 14.8 (#312)

Reasoning benchmarks
BenchmarkDeepSeek Coder 1.3BOLMo 2 Furious 13B
LiveBench Reasoning—16.3%
LiveBench Data Analysis—20.6%
Epoch Capabilities Index62.18—
LiveBench—22.1%
WinoGrande53.3%—

Math Not comparable

DeepSeek Coder 1.3B: —, OLMo 2 Furious 13B: 21.3 (#270)

Math benchmarks
BenchmarkDeepSeek Coder 1.3BOLMo 2 Furious 13B
Omni-MATH—15.6%
LiveBench Math—13.6%
GSM8K4.4%—

Knowledge Not comparable

DeepSeek Coder 1.3B: —, OLMo 2 Furious 13B: 18.0 (#278)

Knowledge benchmarks
BenchmarkDeepSeek Coder 1.3BOLMo 2 Furious 13B
MMLU-Pro—31%
GPQA (HELM)—31.6%
ARC (AI2) Challenge25.4%—
MMLU25.8%—

Instruction Following Not comparable

DeepSeek Coder 1.3B: —, OLMo 2 Furious 13B: 61.1 (#243)

Instruction Following benchmarks
BenchmarkDeepSeek Coder 1.3BOLMo 2 Furious 13B
LiveBench Instruction Following—60.6%
IFEval—73%

Writing & Preference Not comparable

DeepSeek Coder 1.3B: —, OLMo 2 Furious 13B: 43.0 (#226)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 1.3BOLMo 2 Furious 13B
WildBench—68.9%
LiveBench Language—11.2%

Frequently asked questions

Is DeepSeek Coder 1.3B better than OLMo 2 Furious 13B?

OLMo 2 Furious 13B has enough public results to be ranked (#301); DeepSeek Coder 1.3B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 1.3B or OLMo 2 Furious 13B better for coding?

DeepSeek Coder 1.3B scores higher on coding benchmarks: 30.7 versus 28.1 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 1.3B and OLMo 2 Furious 13B share?

0 benchmarks have published results for both models. DeepSeek Coder 1.3B has 9 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper