Model comparison

Llama 3.2 11B vs Pixtral Large

Pixtral Large has enough public results to be ranked (#259); Llama 3.2 11B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Llama 3.2 11B Meta

32.1

Unranked Sparse

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • They share 1 benchmark with published results for both. Llama 3.2 11B scores higher in 0 categories and Pixtral Large in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in multimodal, where Pixtral Large leads 30.6 to 24.4.

Side by side

Llama 3.2 11B and Pixtral Large specifications
Llama 3.2 11BPixtral Large
ProviderMetaMistral AI
Noometry Index32.132.2
Released2024-09-242024-11-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked33

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Llama 3.2 11B: 27.3, Pixtral Large: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 11BPixtral Large
BALROG16.8%—

Reasoning Not comparable

Llama 3.2 11B: —, Pixtral Large: 21.7 (#218)

Reasoning benchmarks
BenchmarkLlama 3.2 11BPixtral Large
EnigmaEval—0.8%

Knowledge Not comparable

Llama 3.2 11B: —, Pixtral Large: —

Knowledge benchmarks
BenchmarkLlama 3.2 11BPixtral Large
MMLU56.5%—

Multimodal Pixtral Large leads

Llama 3.2 11B: 24.4, Pixtral Large: 30.6 (#111)

Multimodal benchmarks
BenchmarkLlama 3.2 11BPixtral Large
LMArena Vision9661089

Writing & Preference Not comparable

Llama 3.2 11B: —, Pixtral Large: 32.9 (#278)

Writing & Preference benchmarks
BenchmarkLlama 3.2 11BPixtral Large
EQ-Bench Creative Writing—988

Frequently asked questions

Is Llama 3.2 11B better than Pixtral Large?

Pixtral Large has enough public results to be ranked (#259); Llama 3.2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Llama 3.2 11B and Pixtral Large share?

1 benchmark has published results for both models. Llama 3.2 11B has 3 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper