Model comparison

Muse Spark 1.1 vs Yi-1.5-34B

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 30.2 on the Noometry Index.

Last verified . 17 shared benchmarks.

Muse Spark 1.1 Meta

49.9

Rank #43 Confirmed

Yi-1.5-34B 01.AI

30.2

Rank #286 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Muse Spark 1.1 scores higher in 8 categories and Yi-1.5-34B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark 1.1 leads 52.8 to 14.8.
  • Yi-1.5-34B has downloadable open weights; the other is API-only.

Side by side

Muse Spark 1.1 and Yi-1.5-34B specifications
Muse Spark 1.1Yi-1.5-34B
ProviderMeta01.AI
Noometry Index49.930.2
Released2026-04-082024-05-13
WeightsProprietaryOpen
Context window1.05M—
Max output131K—
Input $ / M tokens$1.25—
Output $ / M tokens$4.25—
Results tracked3621

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Muse Spark 1.1: 50.8 (#38), Yi-1.5-34B: 31.9 (#267)

Coding benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
LMArena Coding14971169
DeepSWE53.3%—
LMArena WebDev1542—
SciCode58.8%—
BigCodeBench Instruct—33.9%
BigCodeBench Complete—43.8%

Agentic & Tool Use Not comparable

Muse Spark 1.1: 33.9 (#45), Yi-1.5-34B: —

Agentic & Tool Use benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
τ²-bench Banking40.5%—
GBAEval7.9%—
GDP.pdf15%—
Vending-Bench 26,520—

Reasoning Muse Spark 1.1 leads

Muse Spark 1.1: 45.9 (#41), Yi-1.5-34B: 21.5 (#195)

Reasoning benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
LMArena Hard Prompts14861160
NYT Connections (extended)84.9%—
CritPt15.1%—
DTBench94.4%—
LMCA49.9%—
Surface Evolver Bench52.5%—
Epoch Capabilities Index154.32—

Math Muse Spark 1.1 leads

Muse Spark 1.1: 44.0 (#67), Yi-1.5-34B: 25.3 (#248)

Math benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
LMArena Math14771182
ProofBench39%—
MATH Level 5—25.5%

Knowledge Muse Spark 1.1 leads

Muse Spark 1.1: 52.8 (#55), Yi-1.5-34B: 14.8 (#290)

Knowledge benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
LMArena Expert14801144
GPQA Diamond—32%
SimpleQA Verified57.8%—

Multimodal Not comparable

Muse Spark 1.1: 41.9 (#28), Yi-1.5-34B: —

Multimodal benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
LMArena Vision1292—
LMArena Document1465—

Multilingual Muse Spark 1.1 leads

Muse Spark 1.1: 56.8 (#16), Yi-1.5-34B: 32.5 (#251)

Multilingual benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
LMArena Non-English14711121
LMArena Chinese15181213
LMArena French14941155
LMArena German14661111
LMArena Japanese14451021
LMArena Korean14591005
LMArena Russian14821091
LMArena Spanish14711120

Instruction Following Muse Spark 1.1 leads

Muse Spark 1.1: 76.8 (#36), Yi-1.5-34B: 59.4 (#252)

Instruction Following benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
LMArena Instruction Following14571139

Long Context Muse Spark 1.1 leads

Muse Spark 1.1: 44.8 (#55), Yi-1.5-34B: 34.6 (#243)

Long Context benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
LMArena Longer Query14631144

Writing & Preference Muse Spark 1.1 leads

Muse Spark 1.1: 73.6 (#11), Yi-1.5-34B: 37.6 (#252)

Writing & Preference benchmarks
BenchmarkMuse Spark 1.1Yi-1.5-34B
LMArena Text14791173
LMArena Creative Writing14401135
LMArena Multi-Turn14841153
EQ-Bench Creative Writing1927—
EQ-Bench 41260—

Frequently asked questions

Is Muse Spark 1.1 better than Yi-1.5-34B?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 30.2 on the Noometry Index.

Is Muse Spark 1.1 or Yi-1.5-34B better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 50.8 versus 31.9 in the Noometry coding category.

How many benchmarks do Muse Spark 1.1 and Yi-1.5-34B share?

17 benchmarks have published results for both models. Muse Spark 1.1 has 36 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper