Model comparison

Claude Sonnet 4 vs Muse Spark

Muse Spark is the stronger model overall, scoring 50.3 to 40.6 on the Noometry Index.

Last verified . 25 shared benchmarks.

Claude Sonnet 4 Anthropic

40.6

Rank #139 Confirmed

Muse Spark Meta

50.3

Rank #41 Confirmed

Summary

  • They share 25 benchmarks with published results for both. Claude Sonnet 4 scores higher in 0 categories and Muse Spark in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark leads 65.7 to 41.6.
  • The biggest single-benchmark swing is Humanity's Last Exam: 7.8% for Claude Sonnet 4 and 40.6% for Muse Spark.

Side by side

Claude Sonnet 4 and Muse Spark specifications
Claude Sonnet 4Muse Spark
ProviderAnthropicMeta
Noometry Index40.650.3
Released2025-05-222026-04-08
WeightsProprietaryProprietary
Context window200K—
Max output64K—
Input $ / M tokens$3—
Output $ / M tokens$15—
Results tracked5827

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark leads

Claude Sonnet 4: 44.0 (#70), Muse Spark: 45.6 (#65)

Coding benchmarks
BenchmarkClaude Sonnet 4Muse Spark
SciCode40%51.5%
LMArena Coding14141482
SWE-bench Verified (bash only)64.9%—
Aider Polyglot61.3%—
GSO4.9%—
WeirdML46.1%—
ALE-Bench655.35—

Agentic & Tool Use Not comparable

Claude Sonnet 4: 38.3 (#29), Muse Spark: —

Agentic & Tool Use benchmarks
BenchmarkClaude Sonnet 4Muse Spark
TheAgentCompany33.1%—
Cybench35%—
DeepResearch Bench46.6%—
OSWorld43.9%—
METR Time Horizons62%—

Reasoning Muse Spark leads

Claude Sonnet 4: 23.0 (#169), Muse Spark: 34.9 (#61)

Reasoning benchmarks
BenchmarkClaude Sonnet 4Muse Spark
CritPt0.3%11.3%
LMArena Hard Prompts13721475
Epoch Capabilities Index141.69152.09
ARC-AGI-25.9%—
SimpleBench45.5%—
Kagi LLM Benchmark73%—
ARC-AGI-140%—
EnigmaEval3.1%—
DTBench77.1%—
LMCA29%—
ForecastBench60.2—

Math Muse Spark leads

Claude Sonnet 4: 41.5 (#71), Muse Spark: 46.8 (#57)

Math benchmarks
BenchmarkClaude Sonnet 4Muse Spark
OTIS Mock AIME 2024-202571.1%88.9%
LMArena Math13751455
FrontierMath (Feb 2025 set)4.1%39%
FrontierMath Tier 4 (v1)0%14.6%
ProofBench—17%
Omni-MATH60.2%—
MATH Level 584.4%—

Knowledge Muse Spark leads

Claude Sonnet 4: 41.6 (#99), Muse Spark: 65.7 (#12)

Knowledge benchmarks
BenchmarkClaude Sonnet 4Muse Spark
GPQA Diamond79.2%89.8%
Humanity's Last Exam7.8%40.6%
LMArena Expert13711458
MMLU-Pro84.3%—
Confabulations13.2%—
Vectara Hallucination Rate10.3%—
GPQA (HELM)70.6%—

Multimodal Muse Spark leads

Claude Sonnet 4: 25.6 (#116), Muse Spark: 42.7 (#23)

Multimodal benchmarks
BenchmarkClaude Sonnet 4Muse Spark
LMArena Vision11911306
GeoBench37%—
VPCT34%—
LMArena Document—1444
MindCube44.8%—

Multilingual Muse Spark leads

Claude Sonnet 4: 46.9 (#151), Muse Spark: 56.3 (#23)

Multilingual benchmarks
BenchmarkClaude Sonnet 4Muse Spark
LMArena Non-English13331464
LMArena Chinese13511507
LMArena French13641497
LMArena German13311497
LMArena Korean12931457
LMArena Russian13551467
LMArena Spanish13561471
LMArena Japanese1301—

Instruction Following Muse Spark leads

Claude Sonnet 4: 71.8 (#141), Muse Spark: 76.1 (#47)

Instruction Following benchmarks
BenchmarkClaude Sonnet 4Muse Spark
LMArena Instruction Following13751443
IFEval84%—

Long Context Muse Spark leads

Claude Sonnet 4: 33.6 (#254), Muse Spark: 44.4 (#65)

Long Context benchmarks
BenchmarkClaude Sonnet 4Muse Spark
LMArena Longer Query13981451
Fiction.LiveBench46.9%—

Writing & Preference Muse Spark leads

Claude Sonnet 4: 57.3 (#127), Muse Spark: 66.2 (#37)

Writing & Preference benchmarks
BenchmarkClaude Sonnet 4Muse Spark
LMArena Text13511474
LMArena Creative Writing13451460
LMArena Multi-Turn13761477
Short-Story Creative Writing81.4%—
EQ-Bench Creative Writing1483—
WildBench83.8%—

Frequently asked questions

Is Claude Sonnet 4 better than Muse Spark?

Muse Spark is the stronger model overall, scoring 50.3 to 40.6 on the Noometry Index.

Is Claude Sonnet 4 or Muse Spark better for coding?

Muse Spark scores higher on coding benchmarks: 45.6 versus 44.0 in the Noometry coding category.

How many benchmarks do Claude Sonnet 4 and Muse Spark share?

25 benchmarks have published results for both models. Claude Sonnet 4 has 58 scored results on Noometry and Muse Spark has 27.

Related comparisons

Go deeper