Noometry

Model comparison

GPT-4.5 vs Llama 4 Scout

GPT-4.5 is the stronger model overall, scoring 36.9 to 27.4 on the Noometry Index.

Last verified . 26 shared benchmarks.

GPT-4.5 OpenAI

36.9

Rank #200 Confirmed

Llama 4 Scout Meta

27.4

Rank #323 Confirmed

Summary

  • They share 26 benchmarks with published results for both. GPT-4.5 scores higher in 10 categories and Llama 4 Scout in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in coding, where GPT-4.5 leads 41.8 to 19.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 37.8% for GPT-4.5 and 7.8% for Llama 4 Scout.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

GPT-4.5Llama 4 Scout
ProviderOpenAIMeta
Noometry Index36.927.4
Released2025-02-272025-04-05
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked4243

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.5 leads

GPT-4.5: 41.8 (#102), Llama 4 Scout: 19.9 (#334)

BenchmarkGPT-4.5Llama 4 Scout
LMArena Coding13971286
SWE-bench Verified (bash only)—9.1%
Aider Polyglot44.9%—
SciCode—17%
WeirdML39.4%—
LiveBench Coding75.2%—
BigCodeBench Complete—43.1%

Agentic & Tool Use GPT-4.5 leads

GPT-4.5: 27.6 (#92), Llama 4 Scout: 24.4 (#109)

BenchmarkGPT-4.5Llama 4 Scout
Berkeley Function Calling Leaderboard—28.1%
Cybench17.5%—

Reasoning GPT-4.5 leads

GPT-4.5: 14.1 (#320), Llama 4 Scout: 9.2 (#339)

BenchmarkGPT-4.5Llama 4 Scout
ARC-AGI-20.8%0%
ARC-AGI-110.3%0.5%
LMArena Hard Prompts14041266
Epoch Capabilities Index136.74129.64
ForecastBench61.757.5
SimpleBench34.5%—
Kagi LLM Benchmark—36.9%
CritPt—0%
EnigmaEval3.2%—
LiveBench Reasoning71.1%—
DTBench—57.9%
LiveBench Data Analysis64.3%—
LMCA—12%
LiveBench69%—

Math GPT-4.5 leads

GPT-4.5: 31.0 (#200), Llama 4 Scout: 18.4 (#280)

BenchmarkGPT-4.5Llama 4 Scout
OTIS Mock AIME 2024-202537.8%7.8%
LMArena Math14121286
MATH Level 578.6%62.3%
Omni-MATH—37.3%
LiveBench Math69.3%—
FrontierMath (Feb 2025 set)—0%

Knowledge Too close to call

GPT-4.5: 32.4 (#205), Llama 4 Scout: 31.8 (#208)

BenchmarkGPT-4.5Llama 4 Scout
GPQA Diamond68.7%51.8%
LMArena Expert13941236
Humanity's Last Exam5.4%—
MMLU-Pro—74.2%
Confabulations13.6%—
Vectara Hallucination Rate—7.7%
GPQA (HELM)—50.7%

Multimodal GPT-4.5 leads

GPT-4.5: 37.0 (#68), Llama 4 Scout: 31.6 (#98)

BenchmarkGPT-4.5Llama 4 Scout
LMArena Vision11951118
VPCT45%—
SpatialViz-Bench—34.2%

Multilingual GPT-4.5 leads

GPT-4.5: 52.7 (#78), Llama 4 Scout: 41.3 (#207)

BenchmarkGPT-4.5Llama 4 Scout
LMArena Non-English14131253
LMArena Chinese14211256
LMArena French14171283
LMArena German14571274
LMArena Japanese14161209
LMArena Korean13921207
LMArena Russian14191263
LMArena Spanish—1277

Instruction Following GPT-4.5 leads

GPT-4.5: 72.8 (#129), Llama 4 Scout: 66.0 (#212)

BenchmarkGPT-4.5Llama 4 Scout
LMArena Instruction Following14041248
LiveBench Instruction Following72.3%—
IFEval—81.8%

Long Context GPT-4.5 leads

GPT-4.5: 40.4 (#150), Llama 4 Scout: 27.5 (#289)

BenchmarkGPT-4.5Llama 4 Scout
Fiction.LiveBench63.9%36%
LMArena Longer Query14061265

Writing & Preference GPT-4.5 leads

GPT-4.5: 57.1 (#129), Llama 4 Scout: 37.1 (#256)

BenchmarkGPT-4.5Llama 4 Scout
LMArena Text14171279
LMArena Creative Writing13941249
EQ-Bench Creative Writing1258783
LMArena Multi-Turn14441281
Short-Story Creative Writing75.6%—
WildBench—78%
LiveBench Language61.5%—

Frequently asked questions

Is GPT-4.5 better than Llama 4 Scout?

GPT-4.5 is the stronger model overall, scoring 36.9 to 27.4 on the Noometry Index.

Is GPT-4.5 or Llama 4 Scout better for coding?

GPT-4.5 scores higher on coding benchmarks: 41.8 versus 19.9 in the Noometry coding category.

How many benchmarks do GPT-4.5 and Llama 4 Scout share?

26 benchmarks have published results for both models. GPT-4.5 has 42 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper