Model comparison

Mistral Nemo vs Muse Spark 1.2

Muse Spark 1.2 is the stronger model overall, scoring 50.3 to 26.4 on the Noometry Index. Mistral Nemo costs 13× less per token, which makes it the better buy when Muse Spark 1.2's lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Muse Spark 1.2 Meta

50.3

Rank #48 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Mistral Nemo scores higher in 0 categories and Muse Spark 1.2 in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Muse Spark 1.2 leads 72.3 to 28.5.
  • The biggest single-benchmark swing is DTBench: 48.6% for Mistral Nemo and 94.7% for Muse Spark 1.2.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $1.25 / $4.25 for Muse Spark 1.2.
  • Muse Spark 1.2 accepts more context: 1.05M tokens versus 128K.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Mistral Nemo and Muse Spark 1.2 specifications
Mistral NemoMuse Spark 1.2
ProviderMistral AIMeta
Noometry Index26.450.3
Released2024-07-012026-08-05
WeightsOpenProprietary
Context window128K1.05M
Max output128K131K
Input $ / M tokens$0.15$1.25
Output $ / M tokens$0.15$4.25
Results tracked1031

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Nemo: —, Muse Spark 1.2: 49.2 (#51)

Coding benchmarks
BenchmarkMistral NemoMuse Spark 1.2
DeepSWE—54.9%
LMArena WebDev—1533
FrontierSWE—12%
SciCode—56.4%
WeirdML—60.3%
LMArena Coding—1495

Agentic & Tool Use Muse Spark 1.2 leads

Mistral Nemo: 23.5 (#125), Muse Spark 1.2: 29.4 (#87)

Agentic & Tool Use benchmarks
BenchmarkMistral NemoMuse Spark 1.2
APEX-Agents—36.4%
Berkeley Function Calling Leaderboard27.6%—
BALROG17.6%—
GDP.pdf—16%

Reasoning Muse Spark 1.2 leads

Mistral Nemo: 20.7 (#232), Muse Spark 1.2: 51.3 (#34)

Reasoning benchmarks
BenchmarkMistral NemoMuse Spark 1.2
DTBench48.6%94.7%
Epoch Capabilities Index118.68154.87
SimpleBench—74.5%
NYT Connections (extended)—79.2%
CritPt—17.7%
LMArena Hard Prompts—1486
LMCA—48.4%
PIQA83.5%—

Math Muse Spark 1.2 leads

Mistral Nemo: 25.5 (#268), Muse Spark 1.2: 46.4 (#70)

Math benchmarks
BenchmarkMistral NemoMuse Spark 1.2
ProofBench—43%
LMArena Math—1471
MATH Level 510.8%—
GSM8K84.2%—

Knowledge Muse Spark 1.2 leads

Mistral Nemo: 12.3 (#298), Muse Spark 1.2: 54.1 (#53)

Knowledge benchmarks
BenchmarkMistral NemoMuse Spark 1.2
GPQA Diamond29.9%—
SimpleQA Verified—60.3%
LMArena Expert—1480
BoolQ82.5%—

Multimodal Not comparable

Mistral Nemo: —, Muse Spark 1.2: 43.4 (#25)

Multimodal benchmarks
BenchmarkMistral NemoMuse Spark 1.2
LMArena Vision—1305

Multilingual Not comparable

Mistral Nemo: —, Muse Spark 1.2: 57.1 (#11)

Multilingual benchmarks
BenchmarkMistral NemoMuse Spark 1.2
LMArena Non-English—1478
LMArena Chinese—1511
LMArena French—1513
LMArena Russian—1487
LMArena Spanish—1498

Instruction Following Not comparable

Mistral Nemo: —, Muse Spark 1.2: 76.7 (#36)

Instruction Following benchmarks
BenchmarkMistral NemoMuse Spark 1.2
LMArena Instruction Following—1461

Long Context Not comparable

Mistral Nemo: —, Muse Spark 1.2: 45.2 (#48)

Long Context benchmarks
BenchmarkMistral NemoMuse Spark 1.2
LMArena Longer Query—1475

Writing & Preference Muse Spark 1.2 leads

Mistral Nemo: 28.5 (#296), Muse Spark 1.2: 72.3 (#14)

Writing & Preference benchmarks
BenchmarkMistral NemoMuse Spark 1.2
EQ-Bench Creative Writing8811840
LMArena Text—1482
LMArena Creative Writing—1449
LMArena Multi-Turn—1494

Frequently asked questions

Is Mistral Nemo better than Muse Spark 1.2?

Muse Spark 1.2 is the stronger model overall, scoring 50.3 to 26.4 on the Noometry Index. Mistral Nemo costs 13× less per token, which makes it the better buy when Muse Spark 1.2's lead doesn't matter for your workload.

Which is cheaper, Mistral Nemo or Muse Spark 1.2?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Muse Spark 1.2 lists at $1.25 and $4.25.

Which has the bigger context window?

Muse Spark 1.2 does, with 1.05M tokens against 128K.

How many benchmarks do Mistral Nemo and Muse Spark 1.2 share?

3 benchmarks have published results for both models. Mistral Nemo has 10 scored results on Noometry and Muse Spark 1.2 has 31.

Related comparisons

Go deeper