Model comparison

DeepSeek Coder 6.7B vs Pixtral Large

Pixtral Large has enough public results to be ranked (#257); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

DeepSeek Coder 6.7B DeepSeek

37.1

Unranked Sparse

Pixtral Large Mistral AI

31.7

Rank #257 Reported

Side by side

DeepSeek Coder 6.7B and Pixtral Large specifications
DeepSeek Coder 6.7BPixtral Large
ProviderDeepSeekMistral AI
Noometry Index37.131.7
Released2023-11-022024-11-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked93

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DeepSeek Coder 6.7B: 35.2 (#216), Pixtral Large: —

Coding benchmarks
BenchmarkDeepSeek Coder 6.7BPixtral Large
BigCodeBench Instruct35.5%—
BigCodeBench Complete43.8%—
HumanEval+71.3%—
MBPP+65.6%—

Reasoning Not comparable

DeepSeek Coder 6.7B: —, Pixtral Large: 20.9 (#208)

Reasoning benchmarks
BenchmarkDeepSeek Coder 6.7BPixtral Large
EnigmaEval—0.8%
Epoch Capabilities Index88.88—
WinoGrande57.6%—

Math Not comparable

DeepSeek Coder 6.7B: —, Pixtral Large: —

Math benchmarks
BenchmarkDeepSeek Coder 6.7BPixtral Large
GSM8K21.3%—

Knowledge Not comparable

DeepSeek Coder 6.7B: —, Pixtral Large: —

Knowledge benchmarks
BenchmarkDeepSeek Coder 6.7BPixtral Large
ARC (AI2) Challenge36.4%—
MMLU36.4%—

Multimodal Not comparable

DeepSeek Coder 6.7B: —, Pixtral Large: 30.0 (#105)

Multimodal benchmarks
BenchmarkDeepSeek Coder 6.7BPixtral Large
LMArena Vision—1089

Writing & Preference Not comparable

DeepSeek Coder 6.7B: —, Pixtral Large: 32.9 (#273)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 6.7BPixtral Large
EQ-Bench Creative Writing—988

Frequently asked questions

Is DeepSeek Coder 6.7B better than Pixtral Large?

Pixtral Large has enough public results to be ranked (#257); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

How many benchmarks do DeepSeek Coder 6.7B and Pixtral Large share?

0 benchmarks have published results for both models. DeepSeek Coder 6.7B has 9 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper