Noometry

Model comparison

Llama 3-70B vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 28.5 on the Noometry Index.

Last verified . 19 shared benchmarks.

Llama 3-70B Meta

28.5

Rank #317 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #43 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Llama 3-70B scores higher in 0 categories and Muse Spark 1.1 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Muse Spark 1.1 leads 44.0 to 12.0.
  • The biggest single-benchmark swing is DTBench: 54.2% for Llama 3-70B and 94.4% for Muse Spark 1.1.
  • Llama 3-70B has downloadable open weights; the other is API-only.

Side by side

Llama 3-70BMuse Spark 1.1
ProviderMetaMeta
Noometry Index28.549.9
Released2024-04-182026-04-08
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked3136

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Llama 3-70B: 35.3 (#215), Muse Spark 1.1: 50.8 (#38)

BenchmarkLlama 3-70BMuse Spark 1.1
LMArena Coding12061497
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%
BigCodeBench Instruct43.6%—
BigCodeBench Complete54.5%—
HumanEval+72%—
MBPP+69%—

Agentic & Tool Use Muse Spark 1.1 leads

Llama 3-70B: 20.9 (#132), Muse Spark 1.1: 33.9 (#45)

BenchmarkLlama 3-70BMuse Spark 1.1
τ²-bench Banking—40.5%
Cybench5%—
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Llama 3-70B: 17.4 (#284), Muse Spark 1.1: 45.9 (#41)

BenchmarkLlama 3-70BMuse Spark 1.1
LMArena Hard Prompts11951486
DTBench54.2%94.4%
Epoch Capabilities Index122.91154.32
Kagi LLM Benchmark35.1%—
NYT Connections (extended)—84.9%
CritPt—15.1%
LMCA—49.9%
Surface Evolver Bench—52.5%
ForecastBench57.1—
WinoGrande83.5%—

Math Muse Spark 1.1 leads

Llama 3-70B: 12.0 (#299), Muse Spark 1.1: 44.0 (#67)

BenchmarkLlama 3-70BMuse Spark 1.1
LMArena Math12181477
OTIS Mock AIME 2024-20254.3%—
ProofBench—39%
MATH Level 522.6%—

Knowledge Muse Spark 1.1 leads

Llama 3-70B: 20.8 (#272), Muse Spark 1.1: 52.8 (#55)

BenchmarkLlama 3-70BMuse Spark 1.1
LMArena Expert11491480
GPQA Diamond40.6%—
SimpleQA Verified—57.8%
MMLU79.3%—

Multimodal Not comparable

Llama 3-70B: —, Muse Spark 1.1: 41.9 (#28)

BenchmarkLlama 3-70BMuse Spark 1.1
LMArena Vision—1292
LMArena Document—1465

Multilingual Muse Spark 1.1 leads

Llama 3-70B: 33.8 (#246), Muse Spark 1.1: 56.8 (#16)

BenchmarkLlama 3-70BMuse Spark 1.1
LMArena Non-English11421471
LMArena Chinese11141518
LMArena French12311494
LMArena German11691466
LMArena Japanese10171445
LMArena Korean10171459
LMArena Russian11591482
LMArena Spanish12411471

Instruction Following Muse Spark 1.1 leads

Llama 3-70B: 62.8 (#233), Muse Spark 1.1: 76.8 (#36)

BenchmarkLlama 3-70BMuse Spark 1.1
LMArena Instruction Following11941457

Long Context Muse Spark 1.1 leads

Llama 3-70B: 35.6 (#235), Muse Spark 1.1: 44.8 (#55)

BenchmarkLlama 3-70BMuse Spark 1.1
LMArena Longer Query11741463

Writing & Preference Muse Spark 1.1 leads

Llama 3-70B: 43.0 (#225), Muse Spark 1.1: 73.6 (#11)

BenchmarkLlama 3-70BMuse Spark 1.1
LMArena Text12211479
LMArena Creative Writing12101440
LMArena Multi-Turn12231484
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260

Frequently asked questions

Is Llama 3-70B better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 28.5 on the Noometry Index.

Is Llama 3-70B or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 50.8 versus 35.3 in the Noometry coding category.

How many benchmarks do Llama 3-70B and Muse Spark 1.1 share?

19 benchmarks have published results for both models. Llama 3-70B has 31 scored results on Noometry and Muse Spark 1.1 has 36.

Related comparisons

Go deeper