Model comparison

Muse Spark vs Qwen2.5 14B Instruct

Muse Spark has enough public results to be ranked (#46); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Muse Spark Meta

50.6

Rank #46 Confirmed

Summary

  • The widest gap is in coding, where Muse Spark leads 46.2 to 37.7.
  • Qwen2.5 14B Instruct has downloadable open weights; the other is API-only.

Side by side

Muse Spark and Qwen2.5 14B Instruct specifications
Muse SparkQwen2.5 14B Instruct
ProviderMetaAlibaba (Qwen)
Noometry Index50.638.7
Released2026-04-082024-09
WeightsProprietaryOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.35
Output $ / M tokens—$1.40
Results tracked273

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark leads

Muse Spark: 46.2 (#69), Qwen2.5 14B Instruct: 37.7 (#191)

Coding benchmarks
BenchmarkMuse SparkQwen2.5 14B Instruct
SciCode51.5%—
BigCodeBench Instruct—39.8%
LMArena Coding1481—
BigCodeBench Complete—52.2%

Reasoning Not comparable

Muse Spark: 35.9 (#67), Qwen2.5 14B Instruct: —

Reasoning benchmarks
BenchmarkMuse SparkQwen2.5 14B Instruct
CritPt11.3%—
LMArena Hard Prompts1474—
Epoch Capabilities Index152.04—

Math Not comparable

Muse Spark: 47.8 (#66), Qwen2.5 14B Instruct: —

Math benchmarks
BenchmarkMuse SparkQwen2.5 14B Instruct
OTIS Mock AIME 2024-202588.9%—
ProofBench17%—
LMArena Math1455—
FrontierMath (Feb 2025 set)39%—
FrontierMath Tier 4 (v1)14.6%—

Knowledge Not comparable

Muse Spark: 65.7 (#13), Qwen2.5 14B Instruct: —

Knowledge benchmarks
BenchmarkMuse SparkQwen2.5 14B Instruct
GPQA Diamond89.8%—
Humanity's Last Exam40.6%—
LMArena Expert1457—
MMLU—79.9%

Multimodal Not comparable

Muse Spark: 43.4 (#24), Qwen2.5 14B Instruct: —

Multimodal benchmarks
BenchmarkMuse SparkQwen2.5 14B Instruct
LMArena Vision1306—
LMArena Document1444—

Multilingual Not comparable

Muse Spark: 56.1 (#24), Qwen2.5 14B Instruct: —

Multilingual benchmarks
BenchmarkMuse SparkQwen2.5 14B Instruct
LMArena Non-English1464—
LMArena Chinese1509—
LMArena French1497—
LMArena German1497—
LMArena Korean1459—
LMArena Russian1466—
LMArena Spanish1472—

Instruction Following Not comparable

Muse Spark: 75.9 (#51), Qwen2.5 14B Instruct: —

Instruction Following benchmarks
BenchmarkMuse SparkQwen2.5 14B Instruct
LMArena Instruction Following1442—

Long Context Not comparable

Muse Spark: 44.4 (#69), Qwen2.5 14B Instruct: —

Long Context benchmarks
BenchmarkMuse SparkQwen2.5 14B Instruct
LMArena Longer Query1451—

Writing & Preference Not comparable

Muse Spark: 66.0 (#39), Qwen2.5 14B Instruct: —

Writing & Preference benchmarks
BenchmarkMuse SparkQwen2.5 14B Instruct
LMArena Text1474—
LMArena Creative Writing1459—
LMArena Multi-Turn1477—

Frequently asked questions

Is Muse Spark better than Qwen2.5 14B Instruct?

Muse Spark has enough public results to be ranked (#46); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Is Muse Spark or Qwen2.5 14B Instruct better for coding?

Muse Spark scores higher on coding benchmarks: 46.2 versus 37.7 in the Noometry coding category.

How many benchmarks do Muse Spark and Qwen2.5 14B Instruct share?

0 benchmarks have published results for both models. Muse Spark has 27 scored results on Noometry and Qwen2.5 14B Instruct has 3.

Related comparisons

Go deeper