Model comparison

Claude Instant vs Muse Spark 1.1

Muse Spark 1.1 has enough public results to be ranked (#43); Claude Instant does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Claude Instant Anthropic

28.8

Unranked Sparse

Muse Spark 1.1 Meta

49.9

Rank #43 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Claude Instant scores higher in 0 categories and Muse Spark 1.1 in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in reasoning, where Muse Spark 1.1 leads 45.9 to 18.8.
  • The biggest single-benchmark swing is DTBench: 45.8% for Claude Instant and 94.4% for Muse Spark 1.1.

Side by side

Claude Instant and Muse Spark 1.1 specifications
Claude InstantMuse Spark 1.1
ProviderAnthropicMeta
Noometry Index28.849.9
Released2023-08-092026-04-08
WeightsProprietaryProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked736

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Instant: —, Muse Spark 1.1: 50.8 (#38)

Coding benchmarks
BenchmarkClaude InstantMuse Spark 1.1
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%
LMArena Coding—1497
HumanEval+50.6%—

Agentic & Tool Use Not comparable

Claude Instant: —, Muse Spark 1.1: 33.9 (#45)

Agentic & Tool Use benchmarks
BenchmarkClaude InstantMuse Spark 1.1
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Claude Instant: 18.8, Muse Spark 1.1: 45.9 (#41)

Reasoning benchmarks
BenchmarkClaude InstantMuse Spark 1.1
DTBench45.8%94.4%
Epoch Capabilities Index120.2154.32
NYT Connections (extended)—84.9%
CritPt—15.1%
LMArena Hard Prompts—1486
LMCA—49.9%
Surface Evolver Bench—52.5%

Math Not comparable

Claude Instant: —, Muse Spark 1.1: 44.0 (#67)

Math benchmarks
BenchmarkClaude InstantMuse Spark 1.1
ProofBench—39%
LMArena Math—1477
GSM8K86.7%—

Knowledge Not comparable

Claude Instant: —, Muse Spark 1.1: 52.8 (#55)

Knowledge benchmarks
BenchmarkClaude InstantMuse Spark 1.1
SimpleQA Verified—57.8%
LMArena Expert—1480
ARC (AI2) Challenge86.3%—
MMLU73.4%—
TriviaQA78.9%—

Multimodal Not comparable

Claude Instant: —, Muse Spark 1.1: 41.9 (#28)

Multimodal benchmarks
BenchmarkClaude InstantMuse Spark 1.1
LMArena Vision—1292
LMArena Document—1465

Multilingual Not comparable

Claude Instant: —, Muse Spark 1.1: 56.8 (#16)

Multilingual benchmarks
BenchmarkClaude InstantMuse Spark 1.1
LMArena Non-English—1471
LMArena Chinese—1518
LMArena French—1494
LMArena German—1466
LMArena Japanese—1445
LMArena Korean—1459
LMArena Russian—1482
LMArena Spanish—1471

Instruction Following Not comparable

Claude Instant: —, Muse Spark 1.1: 76.8 (#36)

Instruction Following benchmarks
BenchmarkClaude InstantMuse Spark 1.1
LMArena Instruction Following—1457

Long Context Not comparable

Claude Instant: —, Muse Spark 1.1: 44.8 (#55)

Long Context benchmarks
BenchmarkClaude InstantMuse Spark 1.1
LMArena Longer Query—1463

Writing & Preference Not comparable

Claude Instant: —, Muse Spark 1.1: 73.6 (#11)

Writing & Preference benchmarks
BenchmarkClaude InstantMuse Spark 1.1
LMArena Text—1479
LMArena Creative Writing—1440
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260
LMArena Multi-Turn—1484

Frequently asked questions

Is Claude Instant better than Muse Spark 1.1?

Muse Spark 1.1 has enough public results to be ranked (#43); Claude Instant does not yet, so treat this comparison as directional.

How many benchmarks do Claude Instant and Muse Spark 1.1 share?

2 benchmarks have published results for both models. Claude Instant has 7 scored results on Noometry and Muse Spark 1.1 has 36.

Related comparisons

Go deeper