Model comparison

Muse Spark 1.1 vs Yi-Lightning

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 37.1 on the Noometry Index.

Last verified . 17 shared benchmarks.

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Muse Spark 1.1 scores higher in 8 categories and Yi-Lightning in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Muse Spark 1.1 leads 51.3 to 27.4.

Side by side

Muse Spark 1.1 and Yi-Lightning specifications
Muse Spark 1.1Yi-Lightning
ProviderMeta01.AI
Noometry Index49.937.1
Released2026-04-082024-12-02
WeightsProprietaryProprietary
Context window1.05M—
Max output131K—
Input $ / M tokens$1.25—
Output $ / M tokens$4.25—
Results tracked3718

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Muse Spark 1.1: 51.3 (#40), Yi-Lightning: 27.4 (#320)

Coding benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
LMArena Coding14981312
DeepSWE53.3%—
Aider Polyglot—12.9%
LMArena WebDev1542—
SciCode58.8%—

Agentic & Tool Use Not comparable

Muse Spark 1.1: 30.8 (#73), Yi-Lightning: —

Agentic & Tool Use benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
APEX-Agents31.8%—
τ²-bench Banking40.5%—
GBAEval7.9%—
GDP.pdf15%—
Vending-Bench 26,520—

Reasoning Muse Spark 1.1 leads

Muse Spark 1.1: 47.1 (#44), Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
LMArena Hard Prompts14861302
NYT Connections (extended)84.9%—
CritPt15.1%—
DTBench94.4%—
LMCA49.9%—
Surface Evolver Bench52.5%—
Epoch Capabilities Index154.21—

Math Muse Spark 1.1 leads

Muse Spark 1.1: 45.5 (#76), Yi-Lightning: 36.2 (#172)

Math benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
LMArena Math14831300
ProofBench39%—

Knowledge Muse Spark 1.1 leads

Muse Spark 1.1: 53.1 (#59), Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
LMArena Expert14781286
SimpleQA Verified57.8%—

Multimodal Not comparable

Muse Spark 1.1: 42.6 (#29), Yi-Lightning: —

Multimodal benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
LMArena Vision1293—
LMArena Document1465—

Multilingual Muse Spark 1.1 leads

Muse Spark 1.1: 56.7 (#17), Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
LMArena Non-English14721269
LMArena Chinese15181320
LMArena French14941305
LMArena German14661267
LMArena Japanese14511228
LMArena Korean14581192
LMArena Russian14831255
LMArena Spanish14641315

Instruction Following Muse Spark 1.1 leads

Muse Spark 1.1: 76.5 (#39), Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
LMArena Instruction Following14571278

Long Context Muse Spark 1.1 leads

Muse Spark 1.1: 44.8 (#58), Yi-Lightning: 39.4 (#181)

Long Context benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
LMArena Longer Query14621297

Writing & Preference Muse Spark 1.1 leads

Muse Spark 1.1: 73.4 (#11), Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
BenchmarkMuse Spark 1.1Yi-Lightning
LMArena Text14791302
LMArena Creative Writing14371280
LMArena Multi-Turn14851311
EQ-Bench Creative Writing1927—
EQ-Bench 41260—

Frequently asked questions

Is Muse Spark 1.1 better than Yi-Lightning?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 37.1 on the Noometry Index.

Is Muse Spark 1.1 or Yi-Lightning better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 51.3 versus 27.4 in the Noometry coding category.

How many benchmarks do Muse Spark 1.1 and Yi-Lightning share?

17 benchmarks have published results for both models. Muse Spark 1.1 has 37 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper