Model comparison

Mistral Small vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 33.4 on the Noometry Index. Mistral Small costs 7.6× less per token, which makes it the better buy when Muse Spark 1.1's lead doesn't matter for your workload.

Last verified . 22 shared benchmarks.

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Mistral Small scores higher in 0 categories and Muse Spark 1.1 in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Muse Spark 1.1 leads 45.5 to 16.4.
  • The biggest single-benchmark swing is SciCode: 26.5% for Mistral Small and 58.8% for Muse Spark 1.1.
  • Mistral Small is cheaper at $0.15 / $0.60 per million input/output tokens, against $1.25 / $4.25 for Muse Spark 1.1.
  • Muse Spark 1.1 accepts more context: 1.05M tokens versus 262K.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

Mistral Small and Muse Spark 1.1 specifications
Mistral SmallMuse Spark 1.1
ProviderMistral AIMeta
Noometry Index33.449.9
Released2024-02-262026-04-08
WeightsOpenProprietary
Context window262K1.05M
Max output256K131K
Input $ / M tokens$0.15$1.25
Output $ / M tokens$0.60$4.25
Results tracked3937

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Mistral Small: 34.0 (#247), Muse Spark 1.1: 51.3 (#40)

Coding benchmarks
BenchmarkMistral SmallMuse Spark 1.1
SciCode26.5%58.8%
LMArena Coding13621498
DeepSWE—53.3%
LMArena WebDev—1542
BigCodeBench Instruct36.1%—
LiveBench Coding36.2%—
BigCodeBench Complete46.6%—
ALE-Bench497.62—

Agentic & Tool Use Muse Spark 1.1 leads

Mistral Small: 28.1 (#93), Muse Spark 1.1: 30.8 (#73)

Agentic & Tool Use benchmarks
BenchmarkMistral SmallMuse Spark 1.1
APEX-Agents—31.8%
Berkeley Function Calling Leaderboard37.1%—
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Mistral Small: 19.8 (#250), Muse Spark 1.1: 47.1 (#44)

Reasoning benchmarks
BenchmarkMistral SmallMuse Spark 1.1
CritPt0%15.1%
LMArena Hard Prompts13351486
DTBench70.9%94.4%
LMCA20.6%49.9%
Kagi LLM Benchmark37.8%—
NYT Connections (extended)—84.9%
LiveBench Reasoning44.8%—
LiveBench Data Analysis53.7%—
Surface Evolver Bench—52.5%
Epoch Capabilities Index—154.21
LiveBench44%—

Math Muse Spark 1.1 leads

Mistral Small: 16.4 (#293), Muse Spark 1.1: 45.5 (#76)

Math benchmarks
BenchmarkMistral SmallMuse Spark 1.1
LMArena Math13411483
OTIS Mock AIME 2024-20255.8%—
ProofBench—39%
LiveBench Math39.9%—
MATH Level 546.8%—

Knowledge Muse Spark 1.1 leads

Mistral Small: 31.0 (#222), Muse Spark 1.1: 53.1 (#59)

Knowledge benchmarks
BenchmarkMistral SmallMuse Spark 1.1
LMArena Expert12911478
GPQA Diamond47.5%—
SimpleQA Verified—57.8%
Vectara Hallucination Rate5.1%—
MMLU68.7%—

Multimodal Muse Spark 1.1 leads

Mistral Small: 33.5 (#96), Muse Spark 1.1: 42.6 (#29)

Multimodal benchmarks
BenchmarkMistral SmallMuse Spark 1.1
LMArena Vision11421293
LMArena Document—1465

Multilingual Muse Spark 1.1 leads

Mistral Small: 45.5 (#169), Muse Spark 1.1: 56.7 (#17)

Multilingual benchmarks
BenchmarkMistral SmallMuse Spark 1.1
LMArena Non-English13151472
LMArena Chinese13401518
LMArena French13371494
LMArena German13401466
LMArena Japanese12751451
LMArena Korean12591458
LMArena Russian13241483
LMArena Spanish13461464

Instruction Following Muse Spark 1.1 leads

Mistral Small: 66.4 (#209), Muse Spark 1.1: 76.5 (#39)

Instruction Following benchmarks
BenchmarkMistral SmallMuse Spark 1.1
LMArena Instruction Following13101457
LiveBench Instruction Following63.7%—

Long Context Muse Spark 1.1 leads

Mistral Small: 40.4 (#156), Muse Spark 1.1: 44.8 (#58)

Long Context benchmarks
BenchmarkMistral SmallMuse Spark 1.1
LMArena Longer Query13271462

Writing & Preference Muse Spark 1.1 leads

Mistral Small: 52.5 (#171), Muse Spark 1.1: 73.4 (#11)

Writing & Preference benchmarks
BenchmarkMistral SmallMuse Spark 1.1
LMArena Text13381479
LMArena Creative Writing13051437
LMArena Multi-Turn13441485
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260
LiveBench Language30.5%—

Frequently asked questions

Is Mistral Small better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 33.4 on the Noometry Index. Mistral Small costs 7.6× less per token, which makes it the better buy when Muse Spark 1.1's lead doesn't matter for your workload.

Which is cheaper, Mistral Small or Muse Spark 1.1?

Mistral Small is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Muse Spark 1.1 lists at $1.25 and $4.25.

Is Mistral Small or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 51.3 versus 34.0 in the Noometry coding category.

Which has the bigger context window?

Muse Spark 1.1 does, with 1.05M tokens against 262K.

How many benchmarks do Mistral Small and Muse Spark 1.1 share?

22 benchmarks have published results for both models. Mistral Small has 39 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper