Noometry

Model comparison

Grok-3 mini vs Llama 4 Scout

Grok-3 mini is the stronger model overall, scoring 41.2 to 27.7 on the Noometry Index.

Last verified . 31 shared benchmarks.

Grok-3 mini xAI

41.2

Rank #141 Confirmed

Llama 4 Scout Meta

27.7

Rank #330 Confirmed

Summary

  • They share 31 benchmarks with published results for both. Grok-3 mini scores higher in 8 categories and Llama 4 Scout in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok-3 mini leads 42.1 to 19.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 77.8% for Grok-3 mini and 7.8% for Llama 4 Scout.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Grok-3 miniLlama 4 Scout
ProviderxAIMeta
Noometry Index41.227.7
Released2025-04-092025-04-05
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked3543

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok-3 mini leads

Grok-3 mini: 40.8 (#131), Llama 4 Scout: 20.2 (#339)

BenchmarkGrok-3 miniLlama 4 Scout
LMArena Coding13791286
SWE-bench Verified (bash only)—9.1%
Aider Polyglot49.3%—
SciCode—17%
WeirdML42.6%—
BigCodeBench Complete—43.1%

Agentic & Tool Use Not comparable

Grok-3 mini: —, Llama 4 Scout: 24.6 (#119)

BenchmarkGrok-3 miniLlama 4 Scout
Berkeley Function Calling Leaderboard—28.1%

Reasoning Grok-3 mini leads

Grok-3 mini: 13.6 (#334), Llama 4 Scout: 9.1 (#345)

BenchmarkGrok-3 miniLlama 4 Scout
ARC-AGI-20.4%0%
Kagi LLM Benchmark61.3%36.9%
ARC-AGI-116.5%0.5%
LMArena Hard Prompts13751266
Epoch Capabilities Index140.35129.64
CritPt—0%
DTBench—57.9%
LMCA—12%
ForecastBench—57.5

Math Grok-3 mini leads

Grok-3 mini: 42.1 (#85), Llama 4 Scout: 19.6 (#286)

BenchmarkGrok-3 miniLlama 4 Scout
OTIS Mock AIME 2024-202577.8%7.8%
Omni-MATH31.8%37.3%
LMArena Math13861287
MATH Level 590.9%62.3%
FrontierMath (Feb 2025 set)5.9%0%

Knowledge Grok-3 mini leads

Grok-3 mini: 46.4 (#81), Llama 4 Scout: 31.9 (#217)

BenchmarkGrok-3 miniLlama 4 Scout
GPQA Diamond76.3%51.8%
MMLU-Pro79.9%74.2%
GPQA (HELM)67.5%50.7%
LMArena Expert13951235
Confabulations10.8%—
Vectara Hallucination Rate—7.7%

Multimodal Not comparable

Grok-3 mini: —, Llama 4 Scout: 32.2 (#102)

BenchmarkGrok-3 miniLlama 4 Scout
LMArena Vision—1118
SpatialViz-Bench—34.2%

Multilingual Grok-3 mini leads

Grok-3 mini: 48.1 (#145), Llama 4 Scout: 41.0 (#212)

BenchmarkGrok-3 miniLlama 4 Scout
LMArena Non-English13521252
LMArena Chinese13871255
LMArena French13571282
LMArena German13491272
LMArena Japanese13421206
LMArena Korean13351207
LMArena Russian13531263
LMArena Spanish13811278

Instruction Following Grok-3 mini leads

Grok-3 mini: 78.5 (#9), Llama 4 Scout: 65.8 (#217)

BenchmarkGrok-3 miniLlama 4 Scout
IFEval95.1%81.8%
LMArena Instruction Following13571248

Long Context Grok-3 mini leads

Grok-3 mini: 41.0 (#147), Llama 4 Scout: 27.5 (#294)

BenchmarkGrok-3 miniLlama 4 Scout
Fiction.LiveBench66.7%36%
LMArena Longer Query13721265

Writing & Preference Grok-3 mini leads

Grok-3 mini: 52.5 (#169), Llama 4 Scout: 37.0 (#261)

BenchmarkGrok-3 miniLlama 4 Scout
LMArena Text13701279
LMArena Creative Writing13421249
WildBench65.1%78%
LMArena Multi-Turn13551280
Short-Story Creative Writing73.5%—
EQ-Bench Creative Writing—783

Frequently asked questions

Is Grok-3 mini better than Llama 4 Scout?

Grok-3 mini is the stronger model overall, scoring 41.2 to 27.7 on the Noometry Index.

Is Grok-3 mini or Llama 4 Scout better for coding?

Grok-3 mini scores higher on coding benchmarks: 40.8 versus 20.2 in the Noometry coding category.

How many benchmarks do Grok-3 mini and Llama 4 Scout share?

31 benchmarks have published results for both models. Grok-3 mini has 35 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper