Model comparison

GPT-5 vs Llama 3.2 90B

GPT-5 is the stronger model overall, scoring 50.9 to 27.5 on the Noometry Index.

Last verified . 8 shared benchmarks.

GPT-5 OpenAI

50.9

Rank #45 Confirmed

Llama 3.2 90B Meta

27.5

Rank #331 Confirmed

Summary

  • They share 8 benchmarks with published results for both. GPT-5 scores higher in 5 categories and Llama 3.2 90B in 0 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5 leads 55.0 to 11.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 91.4% for GPT-5 and 2.6% for Llama 3.2 90B.
  • Llama 3.2 90B has downloadable open weights; the other is API-only.

Side by side

GPT-5 and Llama 3.2 90B specifications
GPT-5Llama 3.2 90B
ProviderOpenAIMeta
Noometry Index50.927.5
Released2025-08-072024-09-24
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$1.25—
Output $ / M tokens$10—
Results tracked699

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5: 50.3 (#47), Llama 3.2 90B: —

Coding benchmarks
BenchmarkGPT-5Llama 3.2 90B
SWE-bench Verified73.6%—
SWE-bench Verified (bash only)65%—
Aider Polyglot88%—
LMArena WebDev1418—
SciCode42.9%—
GSO6.9%—
WeirdML60.7%—
LMArena Coding1436—
ALE-Bench1,162—
AlgoTune1.67—

Agentic & Tool Use GPT-5 leads

GPT-5: 33.1 (#56), Llama 3.2 90B: 30.0 (#80)

Agentic & Tool Use benchmarks
BenchmarkGPT-5Llama 3.2 90B
BALROG32.8%27.3%
Terminal-Bench49.6%—
GDPval34.8%—
Remote Labor Index1.7%—
DeepResearch Bench49.6%—
LMArena Search1133—
METR Time Horizons69.6%—

Reasoning GPT-5 leads

GPT-5: 38.3 (#64), Llama 3.2 90B: 21.7 (#217)

Reasoning benchmarks
BenchmarkGPT-5Llama 3.2 90B
EnigmaEval10.5%0.4%
Epoch Capabilities Index150125.5
ARC-AGI-29.9%—
SimpleBench56.7%—
Kagi LLM Benchmark72.7%—
ARC-AGI-165.7%—
CritPt12.6%—
Chess Puzzles37%—
EBR-Bench12.7%—
LMArena Hard Prompts1416—
Mystery Game Puzzles23%—
DTBench90.7%—
LMCA40%—
ForecastBench61.4—

Math GPT-5 leads

GPT-5: 55.0 (#44), Llama 3.2 90B: 11.1 (#308)

Math benchmarks
BenchmarkGPT-5Llama 3.2 90B
OTIS Mock AIME 2024-202591.4%2.6%
MATH Level 598.1%39.4%
FrontierMath (Tiers 1-3)55.4%—
FrontierMath Tier 422%—
ProofBench18%—
Omni-MATH64.7%—
LMArena Math1407—
FrontierMath (Feb 2025 set)32.4%—
FrontierMath Tier 4 (v1)12.5%—

Knowledge GPT-5 leads

GPT-5: 56.6 (#43), Llama 3.2 90B: 21.7 (#274)

Knowledge benchmarks
BenchmarkGPT-5Llama 3.2 90B
GPQA Diamond86.2%41%
Humanity's Last Exam25.3%—
SimpleQA Verified50.1%—
MMLU-Pro86.3%—
Confabulations10.3%—
Vectara Hallucination Rate14.7%—
GPQA (HELM)79.2%—
LMArena Expert1419—
MMLU—80.3%

Multimodal GPT-5 leads

GPT-5: 46.8 (#13), Llama 3.2 90B: 25.4 (#124)

Multimodal benchmarks
BenchmarkGPT-5Llama 3.2 90B
LMArena Vision12321000
GeoBench81%52%
VPCT66%—

Multilingual Not comparable

GPT-5: 51.4 (#110), Llama 3.2 90B: —

Multilingual benchmarks
BenchmarkGPT-5Llama 3.2 90B
LMArena Non-English1397—
LMArena Chinese1422—
LMArena French1410—
LMArena German1416—
LMArena Japanese1409—
LMArena Korean1360—
LMArena Russian1406—
LMArena Spanish1399—

Instruction Following Not comparable

GPT-5: 73.8 (#113), Llama 3.2 90B: —

Instruction Following benchmarks
BenchmarkGPT-5Llama 3.2 90B
IFEval87.5%—
LMArena Instruction Following1388—

Long Context Not comparable

GPT-5: 69.5 (#2), Llama 3.2 90B: —

Long Context benchmarks
BenchmarkGPT-5Llama 3.2 90B
Fiction.LiveBench97.2%—
LMArena Longer Query1399—

Writing & Preference Not comparable

GPT-5: 63.4 (#65), Llama 3.2 90B: —

Writing & Preference benchmarks
BenchmarkGPT-5Llama 3.2 90B
LMArena Text1406—
LMArena Creative Writing1365—
Short-Story Creative Writing86%—
EQ-Bench Creative Writing1627—
WildBench85.7%—
LMArena Multi-Turn1426—

Frequently asked questions

Is GPT-5 better than Llama 3.2 90B?

GPT-5 is the stronger model overall, scoring 50.9 to 27.5 on the Noometry Index.

How many benchmarks do GPT-5 and Llama 3.2 90B share?

8 benchmarks have published results for both models. GPT-5 has 69 scored results on Noometry and Llama 3.2 90B has 9.

Related comparisons

Go deeper