Model comparison

Mistral Nemo vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 26.4 on the Noometry Index. Mistral Nemo costs 13× less per token, which makes it the better buy when Muse Spark 1.1's lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Mistral Nemo scores higher in 0 categories and Muse Spark 1.1 in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Muse Spark 1.1 leads 73.4 to 28.5.
  • The biggest single-benchmark swing is DTBench: 48.6% for Mistral Nemo and 94.4% for Muse Spark 1.1.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $1.25 / $4.25 for Muse Spark 1.1.
  • Muse Spark 1.1 accepts more context: 1.05M tokens versus 128K.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Mistral Nemo and Muse Spark 1.1 specifications
Mistral NemoMuse Spark 1.1
ProviderMistral AIMeta
Noometry Index26.449.9
Released2024-07-012026-04-08
WeightsOpenProprietary
Context window128K1.05M
Max output128K131K
Input $ / M tokens$0.15$1.25
Output $ / M tokens$0.15$4.25
Results tracked1037

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Nemo: —, Muse Spark 1.1: 51.3 (#40)

Coding benchmarks
BenchmarkMistral NemoMuse Spark 1.1
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%
LMArena Coding—1498

Agentic & Tool Use Muse Spark 1.1 leads

Mistral Nemo: 23.5 (#125), Muse Spark 1.1: 30.8 (#73)

Agentic & Tool Use benchmarks
BenchmarkMistral NemoMuse Spark 1.1
APEX-Agents—31.8%
Berkeley Function Calling Leaderboard27.6%—
τ²-bench Banking—40.5%
BALROG17.6%—
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Mistral Nemo: 20.7 (#232), Muse Spark 1.1: 47.1 (#44)

Reasoning benchmarks
BenchmarkMistral NemoMuse Spark 1.1
DTBench48.6%94.4%
Epoch Capabilities Index118.68154.21
NYT Connections (extended)—84.9%
CritPt—15.1%
LMArena Hard Prompts—1486
LMCA—49.9%
Surface Evolver Bench—52.5%
PIQA83.5%—

Math Muse Spark 1.1 leads

Mistral Nemo: 25.5 (#268), Muse Spark 1.1: 45.5 (#76)

Math benchmarks
BenchmarkMistral NemoMuse Spark 1.1
ProofBench—39%
LMArena Math—1483
MATH Level 510.8%—
GSM8K84.2%—

Knowledge Muse Spark 1.1 leads

Mistral Nemo: 12.3 (#298), Muse Spark 1.1: 53.1 (#59)

Knowledge benchmarks
BenchmarkMistral NemoMuse Spark 1.1
GPQA Diamond29.9%—
SimpleQA Verified—57.8%
LMArena Expert—1478
BoolQ82.5%—

Multimodal Not comparable

Mistral Nemo: —, Muse Spark 1.1: 42.6 (#29)

Multimodal benchmarks
BenchmarkMistral NemoMuse Spark 1.1
LMArena Vision—1293
LMArena Document—1465

Multilingual Not comparable

Mistral Nemo: —, Muse Spark 1.1: 56.7 (#17)

Multilingual benchmarks
BenchmarkMistral NemoMuse Spark 1.1
LMArena Non-English—1472
LMArena Chinese—1518
LMArena French—1494
LMArena German—1466
LMArena Japanese—1451
LMArena Korean—1458
LMArena Russian—1483
LMArena Spanish—1464

Instruction Following Not comparable

Mistral Nemo: —, Muse Spark 1.1: 76.5 (#39)

Instruction Following benchmarks
BenchmarkMistral NemoMuse Spark 1.1
LMArena Instruction Following—1457

Long Context Not comparable

Mistral Nemo: —, Muse Spark 1.1: 44.8 (#58)

Long Context benchmarks
BenchmarkMistral NemoMuse Spark 1.1
LMArena Longer Query—1462

Writing & Preference Muse Spark 1.1 leads

Mistral Nemo: 28.5 (#296), Muse Spark 1.1: 73.4 (#11)

Writing & Preference benchmarks
BenchmarkMistral NemoMuse Spark 1.1
EQ-Bench Creative Writing8811927
LMArena Text—1479
LMArena Creative Writing—1437
EQ-Bench 4—1260
LMArena Multi-Turn—1485

Frequently asked questions

Is Mistral Nemo better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 26.4 on the Noometry Index. Mistral Nemo costs 13× less per token, which makes it the better buy when Muse Spark 1.1's lead doesn't matter for your workload.

Which is cheaper, Mistral Nemo or Muse Spark 1.1?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Muse Spark 1.1 lists at $1.25 and $4.25.

Which has the bigger context window?

Muse Spark 1.1 does, with 1.05M tokens against 128K.

How many benchmarks do Mistral Nemo and Muse Spark 1.1 share?

3 benchmarks have published results for both models. Mistral Nemo has 10 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper