Model comparison

Codellama 70b Instruct vs Pixtral Large

Codellama 70b Instruct is the stronger model overall, scoring 33.7 to 32.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Codellama 70b Instruct Meta

33.7

Rank #237 Confirmed

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Side by side

Codellama 70b Instruct and Pixtral Large specifications
Codellama 70b InstructPixtral Large
ProviderMetaMistral AI
Noometry Index33.732.2
Released—2024-11-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked73

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Codellama 70b Instruct: 37.6 (#193), Pixtral Large: —

Coding benchmarks
BenchmarkCodellama 70b InstructPixtral Large
BigCodeBench Instruct40.7%—
BigCodeBench Complete49.6%—
HumanEval+65.9%—

Reasoning Pixtral Large leads

Codellama 70b Instruct: 20.1 (#242), Pixtral Large: 21.7 (#218)

Reasoning benchmarks
BenchmarkCodellama 70b InstructPixtral Large
EnigmaEval—0.8%
LMArena Hard Prompts1052—

Multimodal Not comparable

Codellama 70b Instruct: —, Pixtral Large: 30.6 (#111)

Multimodal benchmarks
BenchmarkCodellama 70b InstructPixtral Large
LMArena Vision—1089

Multilingual Not comparable

Codellama 70b Instruct: 24.8 (#288), Pixtral Large: —

Multilingual benchmarks
BenchmarkCodellama 70b InstructPixtral Large
LMArena Non-English992—

Instruction Following Not comparable

Codellama 70b Instruct: 51.9 (#293), Pixtral Large: —

Instruction Following benchmarks
BenchmarkCodellama 70b InstructPixtral Large
LMArena Instruction Following1024—

Writing & Preference Too close to call

Codellama 70b Instruct: 33.4 (#277), Pixtral Large: 32.9 (#278)

Writing & Preference benchmarks
BenchmarkCodellama 70b InstructPixtral Large
LMArena Text1057—
EQ-Bench Creative Writing—988

Frequently asked questions

Is Codellama 70b Instruct better than Pixtral Large?

Codellama 70b Instruct is the stronger model overall, scoring 33.7 to 32.2 on the Noometry Index.

How many benchmarks do Codellama 70b Instruct and Pixtral Large share?

0 benchmarks have published results for both models. Codellama 70b Instruct has 7 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper