Noometry

Model comparison

Grok 4 Fast vs Llama 4 Scout

Grok 4 Fast is the stronger model overall, scoring 39.0 to 27.4 on the Noometry Index.

Last verified . 25 shared benchmarks.

Grok 4 Fast xAI

39.0

Rank #164 Confirmed

Llama 4 Scout Meta

27.4

Rank #323 Confirmed

Summary

  • They share 25 benchmarks with published results for both. Grok 4 Fast scores higher in 8 categories and Llama 4 Scout in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in long context, where Grok 4 Fast leads 63.2 to 27.5.
  • The biggest single-benchmark swing is Fiction.LiveBench: 94.4% for Grok 4 Fast and 36% for Llama 4 Scout.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Grok 4 FastLlama 4 Scout
ProviderxAIMeta
Noometry Index39.027.4
Released2025-09-192025-04-05
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked3043

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4 Fast leads

Grok 4 Fast: 32.3 (#264), Llama 4 Scout: 19.9 (#334)

BenchmarkGrok 4 FastLlama 4 Scout
LMArena Coding14291286
SWE-bench Verified (bash only)—9.1%
LMArena WebDev1160—
SciCode—17%
WeirdML42.9%—
BigCodeBench Complete—43.1%

Agentic & Tool Use Grok 4 Fast leads

Grok 4 Fast: 29.3 (#80), Llama 4 Scout: 24.4 (#109)

BenchmarkGrok 4 FastLlama 4 Scout
Berkeley Function Calling Leaderboard—28.1%
τ²-bench Banking15.7%—
Cybench30%—
LMArena Search1171—

Reasoning Grok 4 Fast leads

Grok 4 Fast: 22.5 (#179), Llama 4 Scout: 9.2 (#339)

BenchmarkGrok 4 FastLlama 4 Scout
ARC-AGI-25.3%0%
Kagi LLM Benchmark66.1%36.9%
ARC-AGI-148.5%0.5%
LMArena Hard Prompts14131266
DTBench82.7%57.9%
Epoch Capabilities Index144.21129.64
ForecastBench60.557.5
CritPt—0%
LMCA—12%

Math Grok 4 Fast leads

Grok 4 Fast: 36.1 (#126), Llama 4 Scout: 18.4 (#280)

BenchmarkGrok 4 FastLlama 4 Scout
LMArena Math14191286
OTIS Mock AIME 2024-2025—7.8%
Omni-MATH—37.3%
MATH Level 5—62.3%
FrontierMath (Feb 2025 set)—0%

Knowledge Too close to call

Grok 4 Fast: 31.5 (#211), Llama 4 Scout: 31.8 (#208)

BenchmarkGrok 4 FastLlama 4 Scout
Vectara Hallucination Rate19.7%7.7%
LMArena Expert14111236
GPQA Diamond—51.8%
MMLU-Pro—74.2%
GPQA (HELM)—50.7%

Multimodal Not comparable

Grok 4 Fast: —, Llama 4 Scout: 31.6 (#98)

BenchmarkGrok 4 FastLlama 4 Scout
LMArena Vision—1118
SpatialViz-Bench—34.2%

Multilingual Grok 4 Fast leads

Grok 4 Fast: 51.5 (#106), Llama 4 Scout: 41.3 (#207)

BenchmarkGrok 4 FastLlama 4 Scout
LMArena Non-English13971253
LMArena Chinese14581256
LMArena French14331283
LMArena German13831274
LMArena Japanese13581209
LMArena Korean13591207
LMArena Russian13871263
LMArena Spanish14141277

Instruction Following Grok 4 Fast leads

Grok 4 Fast: 73.4 (#116), Llama 4 Scout: 66.0 (#212)

BenchmarkGrok 4 FastLlama 4 Scout
LMArena Instruction Following13881248
IFEval—81.8%

Long Context Grok 4 Fast leads

Grok 4 Fast: 63.2 (#3), Llama 4 Scout: 27.5 (#289)

BenchmarkGrok 4 FastLlama 4 Scout
Fiction.LiveBench94.4%36%
LMArena Longer Query14151265

Writing & Preference Grok 4 Fast leads

Grok 4 Fast: 60.2 (#96), Llama 4 Scout: 37.1 (#256)

BenchmarkGrok 4 FastLlama 4 Scout
LMArena Text14071279
LMArena Creative Writing13881249
LMArena Multi-Turn14141281
EQ-Bench Creative Writing—783
WildBench—78%

Frequently asked questions

Is Grok 4 Fast better than Llama 4 Scout?

Grok 4 Fast is the stronger model overall, scoring 39.0 to 27.4 on the Noometry Index.

Is Grok 4 Fast or Llama 4 Scout better for coding?

Grok 4 Fast scores higher on coding benchmarks: 32.3 versus 19.9 in the Noometry coding category.

How many benchmarks do Grok 4 Fast and Llama 4 Scout share?

25 benchmarks have published results for both models. Grok 4 Fast has 30 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper