Model comparison

Llama 3.2 90B vs o3-mini

o3-mini is the stronger model overall, scoring 36.7 to 27.5 on the Noometry Index.

Last verified . 4 shared benchmarks.

Llama 3.2 90B Meta

27.5

Rank #331 Confirmed

o3-mini OpenAI

36.7

Rank #212 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Llama 3.2 90B scores higher in 2 categories and o3-mini in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where o3-mini leads 28.1 to 11.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 2.6% for Llama 3.2 90B and 76.9% for o3-mini.
  • Llama 3.2 90B has downloadable open weights; the other is API-only.

Side by side

Llama 3.2 90B and o3-mini specifications
Llama 3.2 90Bo3-mini
ProviderMetaOpenAI
Noometry Index27.536.7
Released2024-09-242024-12-20
WeightsOpenProprietary
Context window—200K
Max output—100K
Input $ / M tokens—$1.10
Output $ / M tokens—$4.40
Results tracked951

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, o3-mini: 40.8 (#132)

Coding benchmarks
BenchmarkLlama 3.2 90Bo3-mini
Aider Polyglot—60.4%
SciCode—39.8%
GSO—1.3%
WeirdML—43.7%
LiveBench Coding—82.7%
LMArena Coding—1378
CadEval—54%

Agentic & Tool Use Too close to call

Llama 3.2 90B: 30.0 (#80), o3-mini: 29.6 (#84)

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90Bo3-mini
Cybench—22.5%
BALROG27.3%—

Reasoning Llama 3.2 90B leads

Llama 3.2 90B: 21.7 (#217), o3-mini: 16.3 (#305)

Reasoning benchmarks
BenchmarkLlama 3.2 90Bo3-mini
Epoch Capabilities Index125.5140.34
ARC-AGI-2—3%
SimpleBench—22.8%
ARC-AGI-1—34.5%
CritPt—0.3%
Chess Puzzles—17%
EnigmaEval0.4%—
LiveBench Reasoning—89.6%
LMArena Hard Prompts—1366
Mystery Game Puzzles—7%
DTBench—68.8%
LiveBench Data Analysis—70.6%
LMCA—19%
ForecastBench—59.6
LiveBench—75.9%

Math o3-mini leads

Llama 3.2 90B: 11.1 (#308), o3-mini: 28.1 (#244)

Math benchmarks
BenchmarkLlama 3.2 90Bo3-mini
OTIS Mock AIME 2024-20252.6%76.9%
MATH Level 539.4%96.5%
FrontierMath (Tiers 1-3)—18.6%
FrontierMath Tier 4—0%
LiveBench Math—77.3%
LMArena Math—1396
FrontierMath (Feb 2025 set)—12.4%
FrontierMath Tier 4 (v1)—4.2%

Knowledge o3-mini leads

Llama 3.2 90B: 21.7 (#274), o3-mini: 38.3 (#146)

Knowledge benchmarks
BenchmarkLlama 3.2 90Bo3-mini
GPQA Diamond41%77%
SimpleQA Verified—15.3%
Confabulations—17.9%
LMArena Expert—1364
MMLU80.3%—

Multimodal Not comparable

Llama 3.2 90B: 25.4 (#124), o3-mini: —

Multimodal benchmarks
BenchmarkLlama 3.2 90Bo3-mini
LMArena Vision1000—
GeoBench52%—

Multilingual Not comparable

Llama 3.2 90B: —, o3-mini: 45.7 (#164)

Multilingual benchmarks
BenchmarkLlama 3.2 90Bo3-mini
LMArena Non-English—1319
LMArena Chinese—1379
LMArena French—1334
LMArena German—1303
LMArena Japanese—1286
LMArena Korean—1314
LMArena Russian—1304
LMArena Spanish—1321

Instruction Following Not comparable

Llama 3.2 90B: —, o3-mini: 75.1 (#72)

Instruction Following benchmarks
BenchmarkLlama 3.2 90Bo3-mini
LiveBench Instruction Following—84.4%
LMArena Instruction Following—1337

Long Context Not comparable

Llama 3.2 90B: —, o3-mini: 33.8 (#256)

Long Context benchmarks
BenchmarkLlama 3.2 90Bo3-mini
Fiction.LiveBench—50%
LMArena Longer Query—1343

Writing & Preference Not comparable

Llama 3.2 90B: —, o3-mini: 50.3 (#182)

Writing & Preference benchmarks
BenchmarkLlama 3.2 90Bo3-mini
LMArena Text—1337
LMArena Creative Writing—1286
Short-Story Creative Writing—61.7%
LMArena Multi-Turn—1320
LiveBench Language—50.7%

Frequently asked questions

Is Llama 3.2 90B better than o3-mini?

o3-mini is the stronger model overall, scoring 36.7 to 27.5 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and o3-mini share?

4 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and o3-mini has 51.

Related comparisons

Go deeper