Model comparison

Llama 3.2 90B vs o1-pro

o1-pro is the stronger model overall, scoring 31.2 to 27.1 on the Noometry Index.

Last verified . 1 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

o1-pro OpenAI

31.2

Rank #264 Reported

Summary

  • They share 1 benchmark with published results for both. Llama 3.2 90B scores higher in 1 category and o1-pro in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in knowledge, where o1-pro leads 29.3 to 21.7.
  • The biggest single-benchmark swing is EnigmaEval: 0.4% for Llama 3.2 90B and 6.1% for o1-pro.
  • Llama 3.2 90B has downloadable open weights; the other is API-only.

Side by side

Llama 3.2 90B and o1-pro specifications
Llama 3.2 90Bo1-pro
ProviderMetaOpenAI
Noometry Index27.131.2
Released2024-09-242025-03-19
WeightsOpenProprietary
Context window—200K
Max output—100K
Input $ / M tokens—$150
Output $ / M tokens—$600
Results tracked93

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Llama 3.2 90B: 29.7 (#73), o1-pro: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90Bo1-pro
BALROG27.3%—

Reasoning Too close to call

Llama 3.2 90B: 20.9 (#207), o1-pro: 20.2 (#223)

Reasoning benchmarks
BenchmarkLlama 3.2 90Bo1-pro
EnigmaEval0.4%6.1%
ARC-AGI-1—23.3%
Epoch Capabilities Index125.5—

Math Not comparable

Llama 3.2 90B: 10.4 (#302), o1-pro: —

Math benchmarks
BenchmarkLlama 3.2 90Bo1-pro
OTIS Mock AIME 2024-20252.6%—
MATH Level 539.4%—

Knowledge o1-pro leads

Llama 3.2 90B: 21.7 (#269), o1-pro: 29.3 (#227)

Knowledge benchmarks
BenchmarkLlama 3.2 90Bo1-pro
GPQA Diamond41%—
Humanity's Last Exam—8.1%
MMLU80.3%—

Multimodal Not comparable

Llama 3.2 90B: 24.9 (#119), o1-pro: —

Multimodal benchmarks
BenchmarkLlama 3.2 90Bo1-pro
LMArena Vision1000—
GeoBench52%—

Frequently asked questions

Is Llama 3.2 90B better than o1-pro?

o1-pro is the stronger model overall, scoring 31.2 to 27.1 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and o1-pro share?

1 benchmark has published results for both models. Llama 3.2 90B has 9 scored results on Noometry and o1-pro has 3.

Related comparisons

Go deeper