Model comparison

Llama 3.2 90B vs Qwen-7B

Llama 3.2 90B has enough public results to be ranked (#331); Qwen-7B does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Llama 3.2 90B Meta

27.5

Rank #331 Confirmed

Summary

  • They share 2 benchmarks with published results for both.

Side by side

Llama 3.2 90B and Qwen-7B specifications
Llama 3.2 90BQwen-7B
ProviderMetaAlibaba (Qwen)
Noometry Index27.5—
Released2024-09-242023-09-28
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked98

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Llama 3.2 90B: 30.0 (#80), Qwen-7B: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BQwen-7B
BALROG27.3%—

Reasoning Not comparable

Llama 3.2 90B: 21.7 (#217), Qwen-7B: —

Reasoning benchmarks
BenchmarkLlama 3.2 90BQwen-7B
Epoch Capabilities Index125.5106.83
EnigmaEval0.4%—
BIG-Bench Hard—45%
LAMBADA—67.9%
PIQA—77.9%

Math Not comparable

Llama 3.2 90B: 11.1 (#308), Qwen-7B: —

Math benchmarks
BenchmarkLlama 3.2 90BQwen-7B
OTIS Mock AIME 2024-20252.6%—
MATH Level 539.4%—
GSM8K—51.7%

Knowledge Not comparable

Llama 3.2 90B: 21.7 (#274), Qwen-7B: —

Knowledge benchmarks
BenchmarkLlama 3.2 90BQwen-7B
MMLU80.3%45%
GPQA Diamond41%—
ARC (AI2) Challenge—75.3%
BoolQ—76.4%

Multimodal Not comparable

Llama 3.2 90B: 25.4 (#124), Qwen-7B: —

Multimodal benchmarks
BenchmarkLlama 3.2 90BQwen-7B
LMArena Vision1000—
GeoBench52%—

Frequently asked questions

Is Llama 3.2 90B better than Qwen-7B?

Llama 3.2 90B has enough public results to be ranked (#331); Qwen-7B does not yet, so treat this comparison as directional.

How many benchmarks do Llama 3.2 90B and Qwen-7B share?

2 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Qwen-7B has 8.

Related comparisons

Go deeper