Noometry

Model comparison

Claude 3.5 Haiku vs Muse Spark

Muse Spark is the stronger model overall, scoring 50.6 to 29.2 on the Noometry Index.

Last verified . 23 shared benchmarks.

Claude 3.5 Haiku Anthropic

29.2

Rank #315 Confirmed

Muse Spark Meta

50.6

Rank #46 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Claude 3.5 Haiku scores higher in 0 categories and Muse Spark in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark leads 65.7 to 18.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.3% for Claude 3.5 Haiku and 88.9% for Muse Spark.

Side by side

Claude 3.5 HaikuMuse Spark
ProviderAnthropicMeta
Noometry Index29.250.6
Released2024-10-222026-04-08
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked4927

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark leads

Claude 3.5 Haiku: 32.9 (#265), Muse Spark: 46.2 (#69)

BenchmarkClaude 3.5 HaikuMuse Spark
SciCode27.4%51.5%
LMArena Coding12861481
Aider Polyglot28%—
WeirdML30.7%—
BigCodeBench Instruct46.1%—
LiveBench Coding51.4%—
BigCodeBench Complete59%—
CadEval32%—

Agentic & Tool Use Not comparable

Claude 3.5 Haiku: 28.0 (#95), Muse Spark: —

BenchmarkClaude 3.5 HaikuMuse Spark
BALROG19.3%—

Reasoning Muse Spark leads

Claude 3.5 Haiku: 17.7 (#290), Muse Spark: 35.9 (#67)

BenchmarkClaude 3.5 HaikuMuse Spark
CritPt0%11.3%
LMArena Hard Prompts12511474
Epoch Capabilities Index127.15152.04
LiveBench Reasoning28.1%—
DTBench56.7%—
LiveBench Data Analysis48.5%—
LiveBench43.5%—

Math Muse Spark leads

Claude 3.5 Haiku: 14.7 (#300), Muse Spark: 47.8 (#66)

BenchmarkClaude 3.5 HaikuMuse Spark
OTIS Mock AIME 2024-20254.3%88.9%
LMArena Math12441455
FrontierMath (Feb 2025 set)0.3%39%
ProofBench—17%
Omni-MATH22.4%—
LiveBench Math35.5%—
MATH Level 546.4%—
FrontierMath Tier 4 (v1)—14.6%

Knowledge Muse Spark leads

Claude 3.5 Haiku: 18.7 (#281), Muse Spark: 65.7 (#13)

BenchmarkClaude 3.5 HaikuMuse Spark
GPQA Diamond38.1%89.8%
LMArena Expert12081457
Humanity's Last Exam—40.6%
MMLU-Pro60.5%—
Confabulations36.7%—
GPQA (HELM)36.3%—
MMLU74.3%—

Multimodal Muse Spark leads

Claude 3.5 Haiku: 26.8 (#117), Muse Spark: 43.4 (#24)

BenchmarkClaude 3.5 HaikuMuse Spark
LMArena Vision10921306
GeoBench34%—
LMArena Document—1444

Multilingual Muse Spark leads

Claude 3.5 Haiku: 40.0 (#218), Muse Spark: 56.1 (#24)

BenchmarkClaude 3.5 HaikuMuse Spark
LMArena Non-English12381464
LMArena Chinese12291509
LMArena French12641497
LMArena German12371497
LMArena Korean11731459
LMArena Russian12531466
LMArena Spanish12611472
LMArena Japanese1175—

Instruction Following Muse Spark leads

Claude 3.5 Haiku: 62.9 (#234), Muse Spark: 75.9 (#51)

BenchmarkClaude 3.5 HaikuMuse Spark
LMArena Instruction Following12411442
LiveBench Instruction Following61.9%—
IFEval79.2%—

Long Context Muse Spark leads

Claude 3.5 Haiku: 38.3 (#200), Muse Spark: 44.4 (#69)

BenchmarkClaude 3.5 HaikuMuse Spark
LMArena Longer Query12611451

Writing & Preference Muse Spark leads

Claude 3.5 Haiku: 42.7 (#234), Muse Spark: 66.0 (#39)

BenchmarkClaude 3.5 HaikuMuse Spark
LMArena Text12551474
LMArena Creative Writing12331459
LMArena Multi-Turn12651477
Short-Story Creative Writing73.5%—
EQ-Bench Creative Writing1146—
WildBench76%—
LiveBench Language35.4%—

Frequently asked questions

Is Claude 3.5 Haiku better than Muse Spark?

Muse Spark is the stronger model overall, scoring 50.6 to 29.2 on the Noometry Index.

Is Claude 3.5 Haiku or Muse Spark better for coding?

Muse Spark scores higher on coding benchmarks: 46.2 versus 32.9 in the Noometry coding category.

How many benchmarks do Claude 3.5 Haiku and Muse Spark share?

23 benchmarks have published results for both models. Claude 3.5 Haiku has 49 scored results on Noometry and Muse Spark has 27.

Related comparisons

Go deeper