Model comparison

DeepSeek Coder 1.3B vs Granite 4.0 H Small

Granite 4.0 H Small has enough public results to be ranked (#213); DeepSeek Coder 1.3B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

DeepSeek Coder 1.3B DeepSeek

34.5

Unranked Sparse

Granite 4.0 H Small IBM

35.9

Rank #213 Confirmed

Summary

  • The widest gap is in coding, where Granite 4.0 H Small leads 35.8 to 30.7.

Side by side

DeepSeek Coder 1.3B and Granite 4.0 H Small specifications
DeepSeek Coder 1.3BGranite 4.0 H Small
ProviderDeepSeekIBM
Noometry Index34.535.9
Released2023-11-02—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked919

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.0 H Small leads

DeepSeek Coder 1.3B: 30.7 (#282), Granite 4.0 H Small: 35.8 (#207)

Coding benchmarks
BenchmarkDeepSeek Coder 1.3BGranite 4.0 H Small
BigCodeBench Instruct22.8%—
LMArena Coding—1247
BigCodeBench Complete29.6%—
HumanEval+60.4%—
MBPP+54.8%—

Reasoning Not comparable

DeepSeek Coder 1.3B: —, Granite 4.0 H Small: 23.4 (#164)

Reasoning benchmarks
BenchmarkDeepSeek Coder 1.3BGranite 4.0 H Small
LMArena Hard Prompts—1240
Epoch Capabilities Index62.18—
WinoGrande53.3%—

Math Not comparable

DeepSeek Coder 1.3B: —, Granite 4.0 H Small: 29.3 (#219)

Math benchmarks
BenchmarkDeepSeek Coder 1.3BGranite 4.0 H Small
Omni-MATH—29.6%
LMArena Math—1251
GSM8K4.4%—

Knowledge Not comparable

DeepSeek Coder 1.3B: —, Granite 4.0 H Small: 31.5 (#210)

Knowledge benchmarks
BenchmarkDeepSeek Coder 1.3BGranite 4.0 H Small
MMLU-Pro—56.9%
Vectara Hallucination Rate—5.2%
GPQA (HELM)—38.3%
LMArena Expert—1244
ARC (AI2) Challenge25.4%—
MMLU25.8%—

Multilingual Not comparable

DeepSeek Coder 1.3B: —, Granite 4.0 H Small: 38.7 (#223)

Multilingual benchmarks
BenchmarkDeepSeek Coder 1.3BGranite 4.0 H Small
LMArena Non-English—1216
LMArena Chinese—1250
LMArena Russian—1198
LMArena Spanish—1258

Instruction Following Not comparable

DeepSeek Coder 1.3B: —, Granite 4.0 H Small: 68.9 (#178)

Instruction Following benchmarks
BenchmarkDeepSeek Coder 1.3BGranite 4.0 H Small
IFEval—89%
LMArena Instruction Following—1221

Long Context Not comparable

DeepSeek Coder 1.3B: —, Granite 4.0 H Small: 37.6 (#209)

Long Context benchmarks
BenchmarkDeepSeek Coder 1.3BGranite 4.0 H Small
LMArena Longer Query—1240

Writing & Preference Not comparable

DeepSeek Coder 1.3B: —, Granite 4.0 H Small: 44.0 (#222)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 1.3BGranite 4.0 H Small
LMArena Text—1241
LMArena Creative Writing—1210
WildBench—73.9%
LMArena Multi-Turn—1243

Frequently asked questions

Is DeepSeek Coder 1.3B better than Granite 4.0 H Small?

Granite 4.0 H Small has enough public results to be ranked (#213); DeepSeek Coder 1.3B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 1.3B or Granite 4.0 H Small better for coding?

Granite 4.0 H Small scores higher on coding benchmarks: 35.8 versus 30.7 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 1.3B and Granite 4.0 H Small share?

0 benchmarks have published results for both models. DeepSeek Coder 1.3B has 9 scored results on Noometry and Granite 4.0 H Small has 19.

Related comparisons

Go deeper