Noometry

Model comparison

Gemini Advanced 0514 vs Llama 4 Scout

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 27.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Llama 4 Scout Meta

27.7

Rank #330 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 8 categories and Llama 4 Scout in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Gemini Advanced 0514 leads 36.6 to 20.2.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514Llama 4 Scout
ProviderGoogleMeta
Noometry Index37.727.7
Released—2025-04-05
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked1743

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.6 (#205), Llama 4 Scout: 20.2 (#339)

BenchmarkGemini Advanced 0514Llama 4 Scout
LMArena Coding12551286
SWE-bench Verified (bash only)—9.1%
SciCode—17%
BigCodeBench Complete—43.1%

Agentic & Tool Use Not comparable

Gemini Advanced 0514: —, Llama 4 Scout: 24.6 (#119)

BenchmarkGemini Advanced 0514Llama 4 Scout
Berkeley Function Calling Leaderboard—28.1%

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), Llama 4 Scout: 9.1 (#345)

BenchmarkGemini Advanced 0514Llama 4 Scout
LMArena Hard Prompts12481266
ARC-AGI-2—0%
Kagi LLM Benchmark—36.9%
ARC-AGI-1—0.5%
CritPt—0%
DTBench—57.9%
LMCA—12%
Epoch Capabilities Index—129.64
ForecastBench—57.5

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), Llama 4 Scout: 19.6 (#286)

BenchmarkGemini Advanced 0514Llama 4 Scout
LMArena Math12721287
OTIS Mock AIME 2024-2025—7.8%
Omni-MATH—37.3%
MATH Level 5—62.3%
FrontierMath (Feb 2025 set)—0%

Knowledge Gemini Advanced 0514 leads

Gemini Advanced 0514: 33.3 (#205), Llama 4 Scout: 31.9 (#217)

BenchmarkGemini Advanced 0514Llama 4 Scout
LMArena Expert12151235
GPQA Diamond—51.8%
MMLU-Pro—74.2%
Vectara Hallucination Rate—7.7%
GPQA (HELM)—50.7%

Multimodal Not comparable

Gemini Advanced 0514: —, Llama 4 Scout: 32.2 (#102)

BenchmarkGemini Advanced 0514Llama 4 Scout
LMArena Vision—1118
SpatialViz-Bench—34.2%

Multilingual Gemini Advanced 0514 leads

Gemini Advanced 0514: 42.6 (#192), Llama 4 Scout: 41.0 (#212)

BenchmarkGemini Advanced 0514Llama 4 Scout
LMArena Non-English12741252
LMArena Chinese12741255
LMArena French13071282
LMArena German12751272
LMArena Japanese12421206
LMArena Korean12321207
LMArena Russian12831263
LMArena Spanish12421278

Instruction Following Too close to call

Gemini Advanced 0514: 66.0 (#212), Llama 4 Scout: 65.8 (#217)

BenchmarkGemini Advanced 0514Llama 4 Scout
LMArena Instruction Following12531248
IFEval—81.8%

Long Context Gemini Advanced 0514 leads

Gemini Advanced 0514: 38.0 (#207), Llama 4 Scout: 27.5 (#294)

BenchmarkGemini Advanced 0514Llama 4 Scout
LMArena Longer Query12531265
Fiction.LiveBench—36%

Writing & Preference Gemini Advanced 0514 leads

Gemini Advanced 0514: 48.5 (#200), Llama 4 Scout: 37.0 (#261)

BenchmarkGemini Advanced 0514Llama 4 Scout
LMArena Text12791279
LMArena Creative Writing12841249
LMArena Multi-Turn12691280
EQ-Bench Creative Writing—783
WildBench—78%

Frequently asked questions

Is Gemini Advanced 0514 better than Llama 4 Scout?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 27.7 on the Noometry Index.

Is Gemini Advanced 0514 or Llama 4 Scout better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 20.2 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Llama 4 Scout share?

17 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper