Model comparison

Llama 3.2 3B vs Qwen2.5 32B Instruct

Qwen2.5 32B Instruct is the stronger model overall, scoring 29.7 to 28.4 on the Noometry Index. Llama 3.2 3B costs 10× less per token, which makes it the better buy when Qwen2.5 32B Instruct's lead doesn't matter for your workload.

Last verified . 2 shared benchmarks.

Llama 3.2 3B Meta

28.4

Rank #318 Confirmed

Qwen2.5 32B Instruct Alibaba (Qwen)

29.7

Rank #291 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Llama 3.2 3B scores higher in 3 categories and Qwen2.5 32B Instruct in 1 category; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Llama 3.2 3B leads 29.9 to 15.3.
  • The biggest single-benchmark swing is BigCodeBench Complete: 28.3% for Llama 3.2 3B and 52.3% for Qwen2.5 32B Instruct.
  • Llama 3.2 3B is cheaper at $0.05 / $0.33 per million input/output tokens, against $0.70 / $2.80 for Qwen2.5 32B Instruct.

Side by side

Llama 3.2 3B and Qwen2.5 32B Instruct specifications
Llama 3.2 3BQwen2.5 32B Instruct
ProviderMetaAlibaba (Qwen)
Noometry Index28.429.7
Released2024-09-242024-09
WeightsOpenOpen
Context window131K131K
Max output118K8K
Input $ / M tokens$0.05$0.70
Output $ / M tokens$0.33$2.80
Results tracked187

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 32B Instruct leads

Llama 3.2 3B: 27.1 (#314), Qwen2.5 32B Instruct: 38.1 (#165)

Coding benchmarks
BenchmarkLlama 3.2 3BQwen2.5 32B Instruct
BigCodeBench Instruct23.4%45%
BigCodeBench Complete28.3%52.3%
LMArena Coding1098—

Agentic & Tool Use Not comparable

Llama 3.2 3B: 19.9 (#135), Qwen2.5 32B Instruct: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 3BQwen2.5 32B Instruct
Berkeley Function Calling Leaderboard21.9%—
BALROG10.1%—

Reasoning Llama 3.2 3B leads

Llama 3.2 3B: 20.1 (#225), Qwen2.5 32B Instruct: 18.5 (#262)

Reasoning benchmarks
BenchmarkLlama 3.2 3BQwen2.5 32B Instruct
Chess Puzzles—0%
LMArena Hard Prompts1095—
Epoch Capabilities Index—128.52

Math Llama 3.2 3B leads

Llama 3.2 3B: 29.9 (#213), Qwen2.5 32B Instruct: 15.3 (#289)

Math benchmarks
BenchmarkLlama 3.2 3BQwen2.5 32B Instruct
OTIS Mock AIME 2024-2025—7.4%
LMArena Math1126—
MATH Level 5—56.1%

Knowledge Llama 3.2 3B leads

Llama 3.2 3B: 29.1 (#232), Qwen2.5 32B Instruct: 24.9 (#259)

Knowledge benchmarks
BenchmarkLlama 3.2 3BQwen2.5 32B Instruct
GPQA Diamond—46.1%
LMArena Expert1090—

Multilingual Not comparable

Llama 3.2 3B: 26.4 (#276), Qwen2.5 32B Instruct: —

Multilingual benchmarks
BenchmarkLlama 3.2 3BQwen2.5 32B Instruct
LMArena Non-English1019—
LMArena Chinese1017—
LMArena German1056—
LMArena Russian949—

Instruction Following Not comparable

Llama 3.2 3B: 56.3 (#270), Qwen2.5 32B Instruct: —

Instruction Following benchmarks
BenchmarkLlama 3.2 3BQwen2.5 32B Instruct
LMArena Instruction Following1089—

Long Context Not comparable

Llama 3.2 3B: 33.4 (#256), Qwen2.5 32B Instruct: —

Long Context benchmarks
BenchmarkLlama 3.2 3BQwen2.5 32B Instruct
LMArena Longer Query1101—

Writing & Preference Not comparable

Llama 3.2 3B: 24.9 (#302), Qwen2.5 32B Instruct: —

Writing & Preference benchmarks
BenchmarkLlama 3.2 3BQwen2.5 32B Instruct
LMArena Text1110—
LMArena Creative Writing1094—
EQ-Bench Creative Writing595—
LMArena Multi-Turn1105—

Frequently asked questions

Is Llama 3.2 3B better than Qwen2.5 32B Instruct?

Qwen2.5 32B Instruct is the stronger model overall, scoring 29.7 to 28.4 on the Noometry Index. Llama 3.2 3B costs 10× less per token, which makes it the better buy when Qwen2.5 32B Instruct's lead doesn't matter for your workload.

Which is cheaper, Llama 3.2 3B or Qwen2.5 32B Instruct?

Llama 3.2 3B is cheaper. It lists at $0.05 per million input tokens and $0.33 per million output tokens; Qwen2.5 32B Instruct lists at $0.70 and $2.80.

Is Llama 3.2 3B or Qwen2.5 32B Instruct better for coding?

Qwen2.5 32B Instruct scores higher on coding benchmarks: 38.1 versus 27.1 in the Noometry coding category.

Which has the bigger context window?

Both accept 131K tokens.

How many benchmarks do Llama 3.2 3B and Qwen2.5 32B Instruct share?

2 benchmarks have published results for both models. Llama 3.2 3B has 18 scored results on Noometry and Qwen2.5 32B Instruct has 7.

Related comparisons

Go deeper