Model comparison

Llama 13b vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 24.4 on the Noometry Index.

Last verified . 9 shared benchmarks.

Llama 13b Meta

24.4

Rank #348 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Llama 13b scores higher in 0 categories and Muse Spark 1.1 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Muse Spark 1.1 leads 73.4 to 13.8.
  • Llama 13b has downloadable open weights; the other is API-only.

Side by side

Llama 13b and Muse Spark 1.1 specifications
Llama 13bMuse Spark 1.1
ProviderMetaMeta
Noometry Index24.449.9
Released2023-02-242026-04-08
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked2137

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Llama 13b: 21.4 (#337), Muse Spark 1.1: 51.3 (#40)

Coding benchmarks
BenchmarkLlama 13bMuse Spark 1.1
LMArena Coding6831498
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%

Agentic & Tool Use Not comparable

Llama 13b: —, Muse Spark 1.1: 30.8 (#73)

Agentic & Tool Use benchmarks
BenchmarkLlama 13bMuse Spark 1.1
APEX-Agents—31.8%
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Llama 13b: 14.0 (#329), Muse Spark 1.1: 47.1 (#44)

Reasoning benchmarks
BenchmarkLlama 13bMuse Spark 1.1
LMArena Hard Prompts7281486
Epoch Capabilities Index100.58154.21
NYT Connections (extended)—84.9%
CritPt—15.1%
DTBench—94.4%
LMCA—49.9%
Surface Evolver Bench—52.5%
BIG-Bench Hard37.9%—
HellaSwag79.2%—
LAMBADA75.2%—
PIQA80.1%—
WinoGrande73%—

Math Muse Spark 1.1 leads

Llama 13b: 26.7 (#256), Muse Spark 1.1: 45.5 (#76)

Math benchmarks
BenchmarkLlama 13bMuse Spark 1.1
LMArena Math8381483
ProofBench—39%
GSM8K20.6%—

Knowledge Not comparable

Llama 13b: —, Muse Spark 1.1: 53.1 (#59)

Knowledge benchmarks
BenchmarkLlama 13bMuse Spark 1.1
SimpleQA Verified—57.8%
LMArena Expert—1478
ARC (AI2) Challenge52.7%—
BoolQ78.7%—
MMLU47.7%—
OpenBookQA56.4%—
TriviaQA77.9%—

Multimodal Not comparable

Llama 13b: —, Muse Spark 1.1: 42.6 (#29)

Multimodal benchmarks
BenchmarkLlama 13bMuse Spark 1.1
LMArena Vision—1293
LMArena Document—1465
ScienceQA43.3%—

Multilingual Muse Spark 1.1 leads

Llama 13b: 16.6 (#297), Muse Spark 1.1: 56.7 (#17)

Multilingual benchmarks
BenchmarkLlama 13bMuse Spark 1.1
LMArena Non-English8191472
LMArena Chinese—1518
LMArena French—1494
LMArena German—1466
LMArena Japanese—1451
LMArena Korean—1458
LMArena Russian—1483
LMArena Spanish—1464

Instruction Following Muse Spark 1.1 leads

Llama 13b: 36.7 (#305), Muse Spark 1.1: 76.5 (#39)

Instruction Following benchmarks
BenchmarkLlama 13bMuse Spark 1.1
LMArena Instruction Following7811457

Long Context Not comparable

Llama 13b: —, Muse Spark 1.1: 44.8 (#58)

Long Context benchmarks
BenchmarkLlama 13bMuse Spark 1.1
LMArena Longer Query—1462

Writing & Preference Muse Spark 1.1 leads

Llama 13b: 13.8 (#312), Muse Spark 1.1: 73.4 (#11)

Writing & Preference benchmarks
BenchmarkLlama 13bMuse Spark 1.1
LMArena Text8341479
LMArena Creative Writing7941437
LMArena Multi-Turn7531485
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260

Frequently asked questions

Is Llama 13b better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 24.4 on the Noometry Index.

Is Llama 13b or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 51.3 versus 21.4 in the Noometry coding category.

How many benchmarks do Llama 13b and Muse Spark 1.1 share?

9 benchmarks have published results for both models. Llama 13b has 21 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper