Model comparison

Llama 3.2 90B vs Llama 3-70B

Llama 3-70B is the stronger model overall, scoring 28.5 to 27.1 on the Noometry Index.

Last verified . 5 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Llama 3-70B Meta

28.5

Rank #317 Confirmed

Summary

  • They share 5 benchmarks with published results for both. Llama 3.2 90B scores higher in 3 categories and Llama 3-70B in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in agentic & tool use, where Llama 3.2 90B leads 29.7 to 20.9.
  • The biggest single-benchmark swing is MATH Level 5: 39.4% for Llama 3.2 90B and 22.6% for Llama 3-70B.

Side by side

Llama 3.2 90B and Llama 3-70B specifications
Llama 3.2 90BLlama 3-70B
ProviderMetaMeta
Noometry Index27.128.5
Released2024-09-242024-04-18
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked931

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, Llama 3-70B: 35.3 (#215)

Coding benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
BigCodeBench Instruct—43.6%
LMArena Coding—1206
BigCodeBench Complete—54.5%
HumanEval+—72%
MBPP+—69%

Agentic & Tool Use Llama 3.2 90B leads

Llama 3.2 90B: 29.7 (#73), Llama 3-70B: 20.9 (#132)

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
Cybench—5%
BALROG27.3%—

Reasoning Llama 3.2 90B leads

Llama 3.2 90B: 20.9 (#207), Llama 3-70B: 17.4 (#284)

Reasoning benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
Epoch Capabilities Index125.5122.91
Kagi LLM Benchmark—35.1%
EnigmaEval0.4%—
LMArena Hard Prompts—1195
DTBench—54.2%
ForecastBench—57.1
WinoGrande—83.5%

Math Llama 3-70B leads

Llama 3.2 90B: 10.4 (#302), Llama 3-70B: 12.0 (#299)

Math benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
OTIS Mock AIME 2024-20252.6%4.3%
MATH Level 539.4%22.6%
LMArena Math—1218

Knowledge Too close to call

Llama 3.2 90B: 21.7 (#269), Llama 3-70B: 20.8 (#272)

Knowledge benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
GPQA Diamond41%40.6%
MMLU80.3%79.3%
LMArena Expert—1149

Multimodal Not comparable

Llama 3.2 90B: 24.9 (#119), Llama 3-70B: —

Multimodal benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
LMArena Vision1000—
GeoBench52%—

Multilingual Not comparable

Llama 3.2 90B: —, Llama 3-70B: 33.8 (#246)

Multilingual benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
LMArena Non-English—1142
LMArena Chinese—1114
LMArena French—1231
LMArena German—1169
LMArena Japanese—1017
LMArena Korean—1017
LMArena Russian—1159
LMArena Spanish—1241

Instruction Following Not comparable

Llama 3.2 90B: —, Llama 3-70B: 62.8 (#233)

Instruction Following benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
LMArena Instruction Following—1194

Long Context Not comparable

Llama 3.2 90B: —, Llama 3-70B: 35.6 (#235)

Long Context benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
LMArena Longer Query—1174

Writing & Preference Not comparable

Llama 3.2 90B: —, Llama 3-70B: 43.0 (#225)

Writing & Preference benchmarks
BenchmarkLlama 3.2 90BLlama 3-70B
LMArena Text—1221
LMArena Creative Writing—1210
LMArena Multi-Turn—1223

Frequently asked questions

Is Llama 3.2 90B better than Llama 3-70B?

Llama 3-70B is the stronger model overall, scoring 28.5 to 27.1 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Llama 3-70B share?

5 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Llama 3-70B has 31.

Related comparisons

Go deeper