Noometry

Model comparison

Llama 4 Scout vs Muse Spark

Muse Spark is the stronger model overall, scoring 50.6 to 27.7 on the Noometry Index.

Last verified . 23 shared benchmarks.

Llama 4 Scout Meta

27.7

Rank #330 Confirmed

Muse Spark Meta

50.6

Rank #46 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Llama 4 Scout scores higher in 0 categories and Muse Spark in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark leads 65.7 to 31.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 7.8% for Llama 4 Scout and 88.9% for Muse Spark.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Llama 4 ScoutMuse Spark
ProviderMetaMeta
Noometry Index27.750.6
Released2025-04-052026-04-08
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.30—
Results tracked4327

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark leads

Llama 4 Scout: 20.2 (#339), Muse Spark: 46.2 (#69)

BenchmarkLlama 4 ScoutMuse Spark
SciCode17%51.5%
LMArena Coding12861481
SWE-bench Verified (bash only)9.1%—
BigCodeBench Complete43.1%—

Agentic & Tool Use Not comparable

Llama 4 Scout: 24.6 (#119), Muse Spark: —

BenchmarkLlama 4 ScoutMuse Spark
Berkeley Function Calling Leaderboard28.1%—

Reasoning Muse Spark leads

Llama 4 Scout: 9.1 (#345), Muse Spark: 35.9 (#67)

BenchmarkLlama 4 ScoutMuse Spark
CritPt0%11.3%
LMArena Hard Prompts12661474
Epoch Capabilities Index129.64152.04
ARC-AGI-20%—
Kagi LLM Benchmark36.9%—
ARC-AGI-10.5%—
DTBench57.9%—
LMCA12%—
ForecastBench57.5—

Math Muse Spark leads

Llama 4 Scout: 19.6 (#286), Muse Spark: 47.8 (#66)

BenchmarkLlama 4 ScoutMuse Spark
OTIS Mock AIME 2024-20257.8%88.9%
LMArena Math12871455
FrontierMath (Feb 2025 set)0%39%
ProofBench—17%
Omni-MATH37.3%—
MATH Level 562.3%—
FrontierMath Tier 4 (v1)—14.6%

Knowledge Muse Spark leads

Llama 4 Scout: 31.9 (#217), Muse Spark: 65.7 (#13)

BenchmarkLlama 4 ScoutMuse Spark
GPQA Diamond51.8%89.8%
LMArena Expert12351457
Humanity's Last Exam—40.6%
MMLU-Pro74.2%—
Vectara Hallucination Rate7.7%—
GPQA (HELM)50.7%—

Multimodal Muse Spark leads

Llama 4 Scout: 32.2 (#102), Muse Spark: 43.4 (#24)

BenchmarkLlama 4 ScoutMuse Spark
LMArena Vision11181306
LMArena Document—1444
SpatialViz-Bench34.2%—

Multilingual Muse Spark leads

Llama 4 Scout: 41.0 (#212), Muse Spark: 56.1 (#24)

BenchmarkLlama 4 ScoutMuse Spark
LMArena Non-English12521464
LMArena Chinese12551509
LMArena French12821497
LMArena German12721497
LMArena Korean12071459
LMArena Russian12631466
LMArena Spanish12781472
LMArena Japanese1206—

Instruction Following Muse Spark leads

Llama 4 Scout: 65.8 (#217), Muse Spark: 75.9 (#51)

BenchmarkLlama 4 ScoutMuse Spark
LMArena Instruction Following12481442
IFEval81.8%—

Long Context Muse Spark leads

Llama 4 Scout: 27.5 (#294), Muse Spark: 44.4 (#69)

BenchmarkLlama 4 ScoutMuse Spark
LMArena Longer Query12651451
Fiction.LiveBench36%—

Writing & Preference Muse Spark leads

Llama 4 Scout: 37.0 (#261), Muse Spark: 66.0 (#39)

BenchmarkLlama 4 ScoutMuse Spark
LMArena Text12791474
LMArena Creative Writing12491459
LMArena Multi-Turn12801477
EQ-Bench Creative Writing783—
WildBench78%—

Frequently asked questions

Is Llama 4 Scout better than Muse Spark?

Muse Spark is the stronger model overall, scoring 50.6 to 27.7 on the Noometry Index.

Is Llama 4 Scout or Muse Spark better for coding?

Muse Spark scores higher on coding benchmarks: 46.2 versus 20.2 in the Noometry coding category.

How many benchmarks do Llama 4 Scout and Muse Spark share?

23 benchmarks have published results for both models. Llama 4 Scout has 43 scored results on Noometry and Muse Spark has 27.

Related comparisons

Go deeper