Noometry

Model comparison

Grok 3 vs Llama 4 Scout

Grok 3 is the stronger model overall, scoring 39.9 to 27.7 on the Noometry Index.

Last verified . 33 shared benchmarks.

Grok 3 xAI

39.9

Rank #157 Confirmed

Llama 4 Scout Meta

27.7

Rank #330 Confirmed

Summary

  • They share 33 benchmarks with published results for both. Grok 3 scores higher in 9 categories and Llama 4 Scout in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Grok 3 leads 41.9 to 20.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 55.6% for Grok 3 and 7.8% for Llama 4 Scout.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Grok 3Llama 4 Scout
ProviderxAIMeta
Noometry Index39.927.7
Released2025-04-092025-04-05
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked4043

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 3 leads

Grok 3: 41.9 (#115), Llama 4 Scout: 20.2 (#339)

BenchmarkGrok 3Llama 4 Scout
LMArena Coding14321286
SWE-bench Verified (bash only)—9.1%
Aider Polyglot53.3%—
SciCode—17%
WeirdML37.2%—
BigCodeBench Complete—43.1%

Agentic & Tool Use Grok 3 leads

Grok 3: 30.5 (#76), Llama 4 Scout: 24.6 (#119)

BenchmarkGrok 3Llama 4 Scout
Berkeley Function Calling Leaderboard—28.1%
BALROG29.5%—

Reasoning Grok 3 leads

Grok 3: 13.7 (#333), Llama 4 Scout: 9.1 (#345)

BenchmarkGrok 3Llama 4 Scout
ARC-AGI-20%0%
Kagi LLM Benchmark61.3%36.9%
ARC-AGI-15.5%0.5%
LMArena Hard Prompts14341266
Epoch Capabilities Index138.33129.64
SimpleBench36.1%—
CritPt—0%
DTBench—57.9%
LMCA—12%
ForecastBench—57.5

Math Grok 3 leads

Grok 3: 38.0 (#145), Llama 4 Scout: 19.6 (#286)

BenchmarkGrok 3Llama 4 Scout
OTIS Mock AIME 2024-202555.6%7.8%
Omni-MATH46.4%37.3%
LMArena Math13911287
MATH Level 588.7%62.3%
FrontierMath (Feb 2025 set)3.8%0%
FrontierMath Tier 4 (v1)0%—

Knowledge Grok 3 leads

Grok 3: 46.2 (#82), Llama 4 Scout: 31.9 (#217)

BenchmarkGrok 3Llama 4 Scout
GPQA Diamond75.8%51.8%
MMLU-Pro78.8%74.2%
Vectara Hallucination Rate5.8%7.7%
GPQA (HELM)65%50.7%
LMArena Expert14211235
Confabulations14.2%—

Multimodal Not comparable

Grok 3: —, Llama 4 Scout: 32.2 (#102)

BenchmarkGrok 3Llama 4 Scout
LMArena Vision—1118
SpatialViz-Bench—34.2%

Multilingual Grok 3 leads

Grok 3: 52.3 (#87), Llama 4 Scout: 41.0 (#212)

BenchmarkGrok 3Llama 4 Scout
LMArena Non-English14101252
LMArena Chinese14481255
LMArena French14601282
LMArena German14311272
LMArena Japanese13871206
LMArena Korean13731207
LMArena Russian14161263
LMArena Spanish14171278

Instruction Following Grok 3 leads

Grok 3: 75.0 (#73), Llama 4 Scout: 65.8 (#217)

BenchmarkGrok 3Llama 4 Scout
IFEval88.4%81.8%
LMArena Instruction Following14091248

Long Context Grok 3 leads

Grok 3: 38.7 (#192), Llama 4 Scout: 27.5 (#294)

BenchmarkGrok 3Llama 4 Scout
Fiction.LiveBench58.3%36%
LMArena Longer Query14391265

Writing & Preference Grok 3 leads

Grok 3: 55.8 (#141), Llama 4 Scout: 37.0 (#261)

BenchmarkGrok 3Llama 4 Scout
LMArena Text14261279
LMArena Creative Writing14141249
EQ-Bench Creative Writing1186783
WildBench84.9%78%
LMArena Multi-Turn14251280
Short-Story Creative Writing76.4%—

Frequently asked questions

Is Grok 3 better than Llama 4 Scout?

Grok 3 is the stronger model overall, scoring 39.9 to 27.7 on the Noometry Index.

Is Grok 3 or Llama 4 Scout better for coding?

Grok 3 scores higher on coding benchmarks: 41.9 versus 20.2 in the Noometry coding category.

How many benchmarks do Grok 3 and Llama 4 Scout share?

33 benchmarks have published results for both models. Grok 3 has 40 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper