Noometry

Model comparison

DeepSeek Coder 33B vs Llama 4 Scout

Llama 4 Scout has enough public results to be ranked (#323); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

DeepSeek Coder 33B DeepSeek

38.3

Unranked Sparse

Llama 4 Scout Meta

27.4

Rank #323 Confirmed

Summary

  • They share 2 benchmarks with published results for both. DeepSeek Coder 33B scores higher in 1 category and Llama 4 Scout in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in coding, where DeepSeek Coder 33B leads 37.4 to 19.9.
  • The biggest single-benchmark swing is BigCodeBench Complete: 51.1% for DeepSeek Coder 33B and 43.1% for Llama 4 Scout.

Side by side

DeepSeek Coder 33BLlama 4 Scout
ProviderDeepSeekMeta
Noometry Index38.327.4
Released2023-11-022025-04-05
WeightsOpenOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked943

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek Coder 33B leads

DeepSeek Coder 33B: 37.4 (#180), Llama 4 Scout: 19.9 (#334)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
BigCodeBench Complete51.1%43.1%
SWE-bench Verified (bash only)—9.1%
SciCode—17%
BigCodeBench Instruct42%—
LMArena Coding—1286
HumanEval+75%—
MBPP+70.1%—

Agentic & Tool Use Not comparable

DeepSeek Coder 33B: —, Llama 4 Scout: 24.4 (#109)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
Berkeley Function Calling Leaderboard—28.1%

Reasoning Not comparable

DeepSeek Coder 33B: —, Llama 4 Scout: 9.2 (#339)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
Epoch Capabilities Index95.74129.64
ARC-AGI-2—0%
Kagi LLM Benchmark—36.9%
ARC-AGI-1—0.5%
CritPt—0%
LMArena Hard Prompts—1266
DTBench—57.9%
LMCA—12%
ForecastBench—57.5
WinoGrande62%—

Math Not comparable

DeepSeek Coder 33B: —, Llama 4 Scout: 18.4 (#280)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
OTIS Mock AIME 2024-2025—7.8%
Omni-MATH—37.3%
LMArena Math—1286
MATH Level 5—62.3%
FrontierMath (Feb 2025 set)—0%
GSM8K35.4%—

Knowledge Not comparable

DeepSeek Coder 33B: —, Llama 4 Scout: 31.8 (#208)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
GPQA Diamond—51.8%
MMLU-Pro—74.2%
Vectara Hallucination Rate—7.7%
GPQA (HELM)—50.7%
LMArena Expert—1236
ARC (AI2) Challenge42.2%—
MMLU39.4%—

Multimodal Not comparable

DeepSeek Coder 33B: —, Llama 4 Scout: 31.6 (#98)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
LMArena Vision—1118
SpatialViz-Bench—34.2%

Multilingual Not comparable

DeepSeek Coder 33B: —, Llama 4 Scout: 41.3 (#207)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
LMArena Non-English—1253
LMArena Chinese—1256
LMArena French—1283
LMArena German—1274
LMArena Japanese—1209
LMArena Korean—1207
LMArena Russian—1263
LMArena Spanish—1277

Instruction Following Not comparable

DeepSeek Coder 33B: —, Llama 4 Scout: 66.0 (#212)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
IFEval—81.8%
LMArena Instruction Following—1248

Long Context Not comparable

DeepSeek Coder 33B: —, Llama 4 Scout: 27.5 (#289)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
Fiction.LiveBench—36%
LMArena Longer Query—1265

Writing & Preference Not comparable

DeepSeek Coder 33B: —, Llama 4 Scout: 37.1 (#256)

BenchmarkDeepSeek Coder 33BLlama 4 Scout
LMArena Text—1279
LMArena Creative Writing—1249
EQ-Bench Creative Writing—783
WildBench—78%
LMArena Multi-Turn—1281

Frequently asked questions

Is DeepSeek Coder 33B better than Llama 4 Scout?

Llama 4 Scout has enough public results to be ranked (#323); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 33B or Llama 4 Scout better for coding?

DeepSeek Coder 33B scores higher on coding benchmarks: 37.4 versus 19.9 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 33B and Llama 4 Scout share?

2 benchmarks have published results for both models. DeepSeek Coder 33B has 9 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper