Model comparison

Llama 3.2 3B vs Qwen2.5 14B Instruct

Llama 3.2 3B has enough public results to be ranked (#318); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Llama 3.2 3B Meta

28.4

Rank #318 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Llama 3.2 3B scores higher in 0 categories and Qwen2.5 14B Instruct in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Qwen2.5 14B Instruct leads 37.1 to 27.1.
  • The biggest single-benchmark swing is BigCodeBench Complete: 28.3% for Llama 3.2 3B and 52.2% for Qwen2.5 14B Instruct.
  • Llama 3.2 3B is cheaper at $0.05 / $0.33 per million input/output tokens, against $0.35 / $1.40 for Qwen2.5 14B Instruct.

Side by side

Llama 3.2 3B and Qwen2.5 14B Instruct specifications
Llama 3.2 3BQwen2.5 14B Instruct
ProviderMetaAlibaba (Qwen)
Noometry Index28.438.2
Released2024-09-242024-09
WeightsOpenOpen
Context window131K131K
Max output118K8K
Input $ / M tokens$0.05$0.35
Output $ / M tokens$0.33$1.40
Results tracked183

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 14B Instruct leads

Llama 3.2 3B: 27.1 (#314), Qwen2.5 14B Instruct: 37.1 (#187)

Coding benchmarks
BenchmarkLlama 3.2 3BQwen2.5 14B Instruct
BigCodeBench Instruct23.4%39.8%
BigCodeBench Complete28.3%52.2%
LMArena Coding1098—

Agentic & Tool Use Not comparable

Llama 3.2 3B: 19.9 (#135), Qwen2.5 14B Instruct: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 3BQwen2.5 14B Instruct
Berkeley Function Calling Leaderboard21.9%—
BALROG10.1%—

Reasoning Not comparable

Llama 3.2 3B: 20.1 (#225), Qwen2.5 14B Instruct: —

Reasoning benchmarks
BenchmarkLlama 3.2 3BQwen2.5 14B Instruct
LMArena Hard Prompts1095—

Math Not comparable

Llama 3.2 3B: 29.9 (#213), Qwen2.5 14B Instruct: —

Math benchmarks
BenchmarkLlama 3.2 3BQwen2.5 14B Instruct
LMArena Math1126—

Knowledge Not comparable

Llama 3.2 3B: 29.1 (#232), Qwen2.5 14B Instruct: —

Knowledge benchmarks
BenchmarkLlama 3.2 3BQwen2.5 14B Instruct
LMArena Expert1090—
MMLU—79.9%

Multilingual Not comparable

Llama 3.2 3B: 26.4 (#276), Qwen2.5 14B Instruct: —

Multilingual benchmarks
BenchmarkLlama 3.2 3BQwen2.5 14B Instruct
LMArena Non-English1019—
LMArena Chinese1017—
LMArena German1056—
LMArena Russian949—

Instruction Following Not comparable

Llama 3.2 3B: 56.3 (#270), Qwen2.5 14B Instruct: —

Instruction Following benchmarks
BenchmarkLlama 3.2 3BQwen2.5 14B Instruct
LMArena Instruction Following1089—

Long Context Not comparable

Llama 3.2 3B: 33.4 (#256), Qwen2.5 14B Instruct: —

Long Context benchmarks
BenchmarkLlama 3.2 3BQwen2.5 14B Instruct
LMArena Longer Query1101—

Writing & Preference Not comparable

Llama 3.2 3B: 24.9 (#302), Qwen2.5 14B Instruct: —

Writing & Preference benchmarks
BenchmarkLlama 3.2 3BQwen2.5 14B Instruct
LMArena Text1110—
LMArena Creative Writing1094—
EQ-Bench Creative Writing595—
LMArena Multi-Turn1105—

Frequently asked questions

Is Llama 3.2 3B better than Qwen2.5 14B Instruct?

Llama 3.2 3B has enough public results to be ranked (#318); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Which is cheaper, Llama 3.2 3B or Qwen2.5 14B Instruct?

Llama 3.2 3B is cheaper. It lists at $0.05 per million input tokens and $0.33 per million output tokens; Qwen2.5 14B Instruct lists at $0.35 and $1.40.

Is Llama 3.2 3B or Qwen2.5 14B Instruct better for coding?

Qwen2.5 14B Instruct scores higher on coding benchmarks: 37.1 versus 27.1 in the Noometry coding category.

Which has the bigger context window?

Both accept 131K tokens.

How many benchmarks do Llama 3.2 3B and Qwen2.5 14B Instruct share?

2 benchmarks have published results for both models. Llama 3.2 3B has 18 scored results on Noometry and Qwen2.5 14B Instruct has 3.

Related comparisons

Go deeper