Model comparison

DeepSeek Coder 6.7B vs Llama 3.2 90B

Llama 3.2 90B has enough public results to be ranked (#326); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

DeepSeek Coder 6.7B DeepSeek

37.1

Unranked Sparse

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Summary

  • They share 2 benchmarks with published results for both.

Side by side

DeepSeek Coder 6.7B and Llama 3.2 90B specifications
DeepSeek Coder 6.7BLlama 3.2 90B
ProviderDeepSeekMeta
Noometry Index37.127.1
Released2023-11-022024-09-24
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked99

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DeepSeek Coder 6.7B: 35.2 (#216), Llama 3.2 90B: —

Coding benchmarks
BenchmarkDeepSeek Coder 6.7BLlama 3.2 90B
BigCodeBench Instruct35.5%—
BigCodeBench Complete43.8%—
HumanEval+71.3%—
MBPP+65.6%—

Agentic & Tool Use Not comparable

DeepSeek Coder 6.7B: —, Llama 3.2 90B: 29.7 (#73)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek Coder 6.7BLlama 3.2 90B
BALROG—27.3%

Reasoning Not comparable

DeepSeek Coder 6.7B: —, Llama 3.2 90B: 20.9 (#207)

Reasoning benchmarks
BenchmarkDeepSeek Coder 6.7BLlama 3.2 90B
Epoch Capabilities Index88.88125.5
EnigmaEval—0.4%
WinoGrande57.6%—

Math Not comparable

DeepSeek Coder 6.7B: —, Llama 3.2 90B: 10.4 (#302)

Math benchmarks
BenchmarkDeepSeek Coder 6.7BLlama 3.2 90B
OTIS Mock AIME 2024-2025—2.6%
MATH Level 5—39.4%
GSM8K21.3%—

Knowledge Not comparable

DeepSeek Coder 6.7B: —, Llama 3.2 90B: 21.7 (#269)

Knowledge benchmarks
BenchmarkDeepSeek Coder 6.7BLlama 3.2 90B
MMLU36.4%80.3%
GPQA Diamond—41%
ARC (AI2) Challenge36.4%—

Multimodal Not comparable

DeepSeek Coder 6.7B: —, Llama 3.2 90B: 24.9 (#119)

Multimodal benchmarks
BenchmarkDeepSeek Coder 6.7BLlama 3.2 90B
LMArena Vision—1000
GeoBench—52%

Frequently asked questions

Is DeepSeek Coder 6.7B better than Llama 3.2 90B?

Llama 3.2 90B has enough public results to be ranked (#326); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

How many benchmarks do DeepSeek Coder 6.7B and Llama 3.2 90B share?

2 benchmarks have published results for both models. DeepSeek Coder 6.7B has 9 scored results on Noometry and Llama 3.2 90B has 9.

Related comparisons

Go deeper