Noometry

Model comparison

Llama 4 Scout vs StarCoder 2 7B

Llama 4 Scout has enough public results to be ranked (#323); StarCoder 2 7B does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Llama 4 Scout Meta

27.4

Rank #323 Confirmed

StarCoder 2 7B NVIDIA

36.5

Unranked Sparse

Summary

  • They share 2 benchmarks with published results for both. Llama 4 Scout scores higher in 0 categories and StarCoder 2 7B in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where StarCoder 2 7B leads 34.2 to 19.9.
  • The biggest single-benchmark swing is BigCodeBench Complete: 43.1% for Llama 4 Scout and 27.7% for StarCoder 2 7B.

Side by side

Llama 4 ScoutStarCoder 2 7B
ProviderMetaNVIDIA
Noometry Index27.436.5
Released2025-04-052024-02-20
WeightsOpenOpen
Context window128K—
Max output4K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.30—
Results tracked437

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding StarCoder 2 7B leads

Llama 4 Scout: 19.9 (#334), StarCoder 2 7B: 34.2

BenchmarkLlama 4 ScoutStarCoder 2 7B
BigCodeBench Complete43.1%27.7%
SWE-bench Verified (bash only)9.1%—
SciCode17%—
LMArena Coding1286—
HumanEval+—29.9%

Agentic & Tool Use Not comparable

Llama 4 Scout: 24.4 (#109), StarCoder 2 7B: —

BenchmarkLlama 4 ScoutStarCoder 2 7B
Berkeley Function Calling Leaderboard28.1%—

Reasoning Not comparable

Llama 4 Scout: 9.2 (#339), StarCoder 2 7B: —

BenchmarkLlama 4 ScoutStarCoder 2 7B
Epoch Capabilities Index129.6492.92
ARC-AGI-20%—
Kagi LLM Benchmark36.9%—
ARC-AGI-10.5%—
CritPt0%—
LMArena Hard Prompts1266—
DTBench57.9%—
LMCA12%—
ForecastBench57.5—
WinoGrande—57.1%

Math Not comparable

Llama 4 Scout: 18.4 (#280), StarCoder 2 7B: —

BenchmarkLlama 4 ScoutStarCoder 2 7B
OTIS Mock AIME 2024-20257.8%—
Omni-MATH37.3%—
LMArena Math1286—
MATH Level 562.3%—
FrontierMath (Feb 2025 set)0%—
GSM8K—32.7%

Knowledge Not comparable

Llama 4 Scout: 31.8 (#208), StarCoder 2 7B: —

BenchmarkLlama 4 ScoutStarCoder 2 7B
GPQA Diamond51.8%—
MMLU-Pro74.2%—
Vectara Hallucination Rate7.7%—
GPQA (HELM)50.7%—
LMArena Expert1236—
ARC (AI2) Challenge—38.7%
MMLU—38.8%

Multimodal Not comparable

Llama 4 Scout: 31.6 (#98), StarCoder 2 7B: —

BenchmarkLlama 4 ScoutStarCoder 2 7B
LMArena Vision1118—
SpatialViz-Bench34.2%—

Multilingual Not comparable

Llama 4 Scout: 41.3 (#207), StarCoder 2 7B: —

BenchmarkLlama 4 ScoutStarCoder 2 7B
LMArena Non-English1253—
LMArena Chinese1256—
LMArena French1283—
LMArena German1274—
LMArena Japanese1209—
LMArena Korean1207—
LMArena Russian1263—
LMArena Spanish1277—

Instruction Following Not comparable

Llama 4 Scout: 66.0 (#212), StarCoder 2 7B: —

BenchmarkLlama 4 ScoutStarCoder 2 7B
IFEval81.8%—
LMArena Instruction Following1248—

Long Context Not comparable

Llama 4 Scout: 27.5 (#289), StarCoder 2 7B: —

BenchmarkLlama 4 ScoutStarCoder 2 7B
Fiction.LiveBench36%—
LMArena Longer Query1265—

Writing & Preference Not comparable

Llama 4 Scout: 37.1 (#256), StarCoder 2 7B: —

BenchmarkLlama 4 ScoutStarCoder 2 7B
LMArena Text1279—
LMArena Creative Writing1249—
EQ-Bench Creative Writing783—
WildBench78%—
LMArena Multi-Turn1281—

Frequently asked questions

Is Llama 4 Scout better than StarCoder 2 7B?

Llama 4 Scout has enough public results to be ranked (#323); StarCoder 2 7B does not yet, so treat this comparison as directional.

Is Llama 4 Scout or StarCoder 2 7B better for coding?

StarCoder 2 7B scores higher on coding benchmarks: 34.2 versus 19.9 in the Noometry coding category.

How many benchmarks do Llama 4 Scout and StarCoder 2 7B share?

2 benchmarks have published results for both models. Llama 4 Scout has 43 scored results on Noometry and StarCoder 2 7B has 7.

Related comparisons

Go deeper