Model comparison

Llama 3.2 90B vs Qwen2.5-Coder (1.5B)

Llama 3.2 90B has enough public results to be ranked (#331); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Llama 3.2 90B Meta

27.5

Rank #331 Confirmed

Summary

  • They share 2 benchmarks with published results for both.

Side by side

Llama 3.2 90B and Qwen2.5-Coder (1.5B) specifications
Llama 3.2 90BQwen2.5-Coder (1.5B)
ProviderMetaAlibaba (Qwen)
Noometry Index27.5—
Released2024-09-242024-09-18
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked96

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Llama 3.2 90B: 30.0 (#80), Qwen2.5-Coder (1.5B): —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BQwen2.5-Coder (1.5B)
BALROG27.3%—

Reasoning Not comparable

Llama 3.2 90B: 21.7 (#217), Qwen2.5-Coder (1.5B): —

Reasoning benchmarks
BenchmarkLlama 3.2 90BQwen2.5-Coder (1.5B)
Epoch Capabilities Index125.5113.14
EnigmaEval0.4%—
HellaSwag—76.8%
WinoGrande—72.9%

Math Not comparable

Llama 3.2 90B: 11.1 (#308), Qwen2.5-Coder (1.5B): —

Math benchmarks
BenchmarkLlama 3.2 90BQwen2.5-Coder (1.5B)
OTIS Mock AIME 2024-20252.6%—
MATH Level 539.4%—
GSM8K—86.7%

Knowledge Not comparable

Llama 3.2 90B: 21.7 (#274), Qwen2.5-Coder (1.5B): —

Knowledge benchmarks
BenchmarkLlama 3.2 90BQwen2.5-Coder (1.5B)
MMLU80.3%68%
GPQA Diamond41%—
ARC (AI2) Challenge—60.9%

Multimodal Not comparable

Llama 3.2 90B: 25.4 (#124), Qwen2.5-Coder (1.5B): —

Multimodal benchmarks
BenchmarkLlama 3.2 90BQwen2.5-Coder (1.5B)
LMArena Vision1000—
GeoBench52%—

Frequently asked questions

Is Llama 3.2 90B better than Qwen2.5-Coder (1.5B)?

Llama 3.2 90B has enough public results to be ranked (#331); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

How many benchmarks do Llama 3.2 90B and Qwen2.5-Coder (1.5B) share?

2 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Qwen2.5-Coder (1.5B) has 6.

Related comparisons

Go deeper