Model comparison

Llama 3.2 3B vs Qwen-7B

Llama 3.2 3B has enough public results to be ranked (#318); Qwen-7B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Llama 3.2 3B Meta

28.4

Rank #318 Confirmed

Side by side

Llama 3.2 3B and Qwen-7B specifications
Llama 3.2 3BQwen-7B
ProviderMetaAlibaba (Qwen)
Noometry Index28.4—
Released2024-09-242023-09-28
WeightsOpenOpen
Context window131K—
Max output118K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.33—
Results tracked188

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 3B: 27.1 (#314), Qwen-7B: —

Coding benchmarks
BenchmarkLlama 3.2 3BQwen-7B
BigCodeBench Instruct23.4%—
LMArena Coding1098—
BigCodeBench Complete28.3%—

Agentic & Tool Use Not comparable

Llama 3.2 3B: 19.9 (#135), Qwen-7B: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 3BQwen-7B
Berkeley Function Calling Leaderboard21.9%—
BALROG10.1%—

Reasoning Not comparable

Llama 3.2 3B: 20.1 (#225), Qwen-7B: —

Reasoning benchmarks
BenchmarkLlama 3.2 3BQwen-7B
LMArena Hard Prompts1095—
BIG-Bench Hard—45%
Epoch Capabilities Index—106.47
LAMBADA—67.9%
PIQA—77.9%

Math Not comparable

Llama 3.2 3B: 29.9 (#213), Qwen-7B: —

Math benchmarks
BenchmarkLlama 3.2 3BQwen-7B
LMArena Math1126—
GSM8K—51.7%

Knowledge Not comparable

Llama 3.2 3B: 29.1 (#232), Qwen-7B: —

Knowledge benchmarks
BenchmarkLlama 3.2 3BQwen-7B
LMArena Expert1090—
ARC (AI2) Challenge—75.3%
BoolQ—76.4%
MMLU—45%

Multilingual Not comparable

Llama 3.2 3B: 26.4 (#276), Qwen-7B: —

Multilingual benchmarks
BenchmarkLlama 3.2 3BQwen-7B
LMArena Non-English1019—
LMArena Chinese1017—
LMArena German1056—
LMArena Russian949—

Instruction Following Not comparable

Llama 3.2 3B: 56.3 (#270), Qwen-7B: —

Instruction Following benchmarks
BenchmarkLlama 3.2 3BQwen-7B
LMArena Instruction Following1089—

Long Context Not comparable

Llama 3.2 3B: 33.4 (#256), Qwen-7B: —

Long Context benchmarks
BenchmarkLlama 3.2 3BQwen-7B
LMArena Longer Query1101—

Writing & Preference Not comparable

Llama 3.2 3B: 24.9 (#302), Qwen-7B: —

Writing & Preference benchmarks
BenchmarkLlama 3.2 3BQwen-7B
LMArena Text1110—
LMArena Creative Writing1094—
EQ-Bench Creative Writing595—
LMArena Multi-Turn1105—

Frequently asked questions

Is Llama 3.2 3B better than Qwen-7B?

Llama 3.2 3B has enough public results to be ranked (#318); Qwen-7B does not yet, so treat this comparison as directional.

How many benchmarks do Llama 3.2 3B and Qwen-7B share?

0 benchmarks have published results for both models. Llama 3.2 3B has 18 scored results on Noometry and Qwen-7B has 8.

Related comparisons

Go deeper