Model comparison

Llama 3.2 3B vs Pixtral Large

Pixtral Large is the stronger model overall, scoring 32.2 to 28.9 on the Noometry Index. Llama 3.2 3B costs 25× less per token, which makes it the better buy when Pixtral Large's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

Llama 3.2 3B Meta

28.9

Rank #321 Confirmed

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • They share 1 benchmark with published results for both. Llama 3.2 3B scores higher in 0 categories and Pixtral Large in 2 categories; one gap is clear of the uncertainty.
  • The widest gap is in writing & preference, where Pixtral Large leads 32.9 to 24.7.
  • Llama 3.2 3B is cheaper at $0.05 / $0.33 per million input/output tokens, against $2 / $6 for Pixtral Large.
  • Llama 3.2 3B accepts more context: 131K tokens versus 128K.

Side by side

Llama 3.2 3B and Pixtral Large specifications
Llama 3.2 3BPixtral Large
ProviderMetaMistral AI
Noometry Index28.932.2
Released2024-09-242024-11-01
WeightsOpenOpen
Context window131K128K
Max output118K128K
Input $ / M tokens$0.05$2
Output $ / M tokens$0.33$6
Results tracked183

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 3B: 27.6 (#319), Pixtral Large: —

Coding benchmarks
BenchmarkLlama 3.2 3BPixtral Large
BigCodeBench Instruct23.4%—
LMArena Coding1098—
BigCodeBench Complete28.3%—

Agentic & Tool Use Not comparable

Llama 3.2 3B: 20.1 (#143), Pixtral Large: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 3BPixtral Large
Berkeley Function Calling Leaderboard21.9%—
BALROG10.1%—

Reasoning Too close to call

Llama 3.2 3B: 21.0 (#228), Pixtral Large: 21.7 (#218)

Reasoning benchmarks
BenchmarkLlama 3.2 3BPixtral Large
EnigmaEval—0.8%
LMArena Hard Prompts1095—

Math Not comparable

Llama 3.2 3B: 32.4 (#214), Pixtral Large: —

Math benchmarks
BenchmarkLlama 3.2 3BPixtral Large
LMArena Math1126—

Knowledge Not comparable

Llama 3.2 3B: 29.7 (#235), Pixtral Large: —

Knowledge benchmarks
BenchmarkLlama 3.2 3BPixtral Large
LMArena Expert1090—

Multimodal Not comparable

Llama 3.2 3B: —, Pixtral Large: 30.6 (#111)

Multimodal benchmarks
BenchmarkLlama 3.2 3BPixtral Large
LMArena Vision—1089

Multilingual Not comparable

Llama 3.2 3B: 26.2 (#281), Pixtral Large: —

Multilingual benchmarks
BenchmarkLlama 3.2 3BPixtral Large
LMArena Non-English1019—
LMArena Chinese1017—
LMArena German1056—
LMArena Russian949—

Instruction Following Not comparable

Llama 3.2 3B: 56.0 (#275), Pixtral Large: —

Instruction Following benchmarks
BenchmarkLlama 3.2 3BPixtral Large
LMArena Instruction Following1089—

Long Context Not comparable

Llama 3.2 3B: 33.4 (#261), Pixtral Large: —

Long Context benchmarks
BenchmarkLlama 3.2 3BPixtral Large
LMArena Longer Query1100—

Writing & Preference Pixtral Large leads

Llama 3.2 3B: 24.7 (#307), Pixtral Large: 32.9 (#278)

Writing & Preference benchmarks
BenchmarkLlama 3.2 3BPixtral Large
EQ-Bench Creative Writing595988
LMArena Text1110—
LMArena Creative Writing1094—
LMArena Multi-Turn1105—

Frequently asked questions

Is Llama 3.2 3B better than Pixtral Large?

Pixtral Large is the stronger model overall, scoring 32.2 to 28.9 on the Noometry Index. Llama 3.2 3B costs 25× less per token, which makes it the better buy when Pixtral Large's lead doesn't matter for your workload.

Which is cheaper, Llama 3.2 3B or Pixtral Large?

Llama 3.2 3B is cheaper. It lists at $0.05 per million input tokens and $0.33 per million output tokens; Pixtral Large lists at $2 and $6.

Which has the bigger context window?

Llama 3.2 3B does, with 131K tokens against 128K.

How many benchmarks do Llama 3.2 3B and Pixtral Large share?

1 benchmark has published results for both models. Llama 3.2 3B has 18 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper