Model comparison

Llama 3.2 90B vs Qwen2.5 32B Instruct

Qwen2.5 32B Instruct is the stronger model overall, scoring 29.7 to 27.1 on the Noometry Index.

Last verified . 4 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Qwen2.5 32B Instruct Alibaba (Qwen)

29.7

Rank #291 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Llama 3.2 90B scores higher in 1 category and Qwen2.5 32B Instruct in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen2.5 32B Instruct leads 15.3 to 10.4.
  • The biggest single-benchmark swing is MATH Level 5: 39.4% for Llama 3.2 90B and 56.1% for Qwen2.5 32B Instruct.

Side by side

Llama 3.2 90B and Qwen2.5 32B Instruct specifications
Llama 3.2 90BQwen2.5 32B Instruct
ProviderMetaAlibaba (Qwen)
Noometry Index27.129.7
Released2024-09-242024-09
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.70
Output $ / M tokens—$2.80
Results tracked97

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, Qwen2.5 32B Instruct: 38.1 (#165)

Coding benchmarks
BenchmarkLlama 3.2 90BQwen2.5 32B Instruct
BigCodeBench Instruct—45%
BigCodeBench Complete—52.3%

Agentic & Tool Use Not comparable

Llama 3.2 90B: 29.7 (#73), Qwen2.5 32B Instruct: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BQwen2.5 32B Instruct
BALROG27.3%—

Reasoning Llama 3.2 90B leads

Llama 3.2 90B: 20.9 (#207), Qwen2.5 32B Instruct: 18.5 (#262)

Reasoning benchmarks
BenchmarkLlama 3.2 90BQwen2.5 32B Instruct
Epoch Capabilities Index125.5128.52
Chess Puzzles—0%
EnigmaEval0.4%—

Math Qwen2.5 32B Instruct leads

Llama 3.2 90B: 10.4 (#302), Qwen2.5 32B Instruct: 15.3 (#289)

Math benchmarks
BenchmarkLlama 3.2 90BQwen2.5 32B Instruct
OTIS Mock AIME 2024-20252.6%7.4%
MATH Level 539.4%56.1%

Knowledge Qwen2.5 32B Instruct leads

Llama 3.2 90B: 21.7 (#269), Qwen2.5 32B Instruct: 24.9 (#259)

Knowledge benchmarks
BenchmarkLlama 3.2 90BQwen2.5 32B Instruct
GPQA Diamond41%46.1%
MMLU80.3%—

Multimodal Not comparable

Llama 3.2 90B: 24.9 (#119), Qwen2.5 32B Instruct: —

Multimodal benchmarks
BenchmarkLlama 3.2 90BQwen2.5 32B Instruct
LMArena Vision1000—
GeoBench52%—

Frequently asked questions

Is Llama 3.2 90B better than Qwen2.5 32B Instruct?

Qwen2.5 32B Instruct is the stronger model overall, scoring 29.7 to 27.1 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Qwen2.5 32B Instruct share?

4 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Qwen2.5 32B Instruct has 7.

Related comparisons

Go deeper