Model comparison

Ministral 8B vs Muse Spark 1.2

Muse Spark 1.2 is the stronger model overall, scoring 50.3 to 28.2 on the Noometry Index. Ministral 8B costs 13× less per token, which makes it the better buy when Muse Spark 1.2's lead doesn't matter for your workload.

Last verified . 13 shared benchmarks.

Ministral 8B Mistral AI

28.2

Rank #325 Confirmed

Muse Spark 1.2 Meta

50.3

Rank #48 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Ministral 8B scores higher in 0 categories and Muse Spark 1.2 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark 1.2 leads 54.1 to 12.6.
  • The biggest single-benchmark swing is DTBench: 45.7% for Ministral 8B and 94.7% for Muse Spark 1.2.
  • Ministral 8B is cheaper at $0.15 / $0.15 per million input/output tokens, against $1.25 / $4.25 for Muse Spark 1.2.
  • Muse Spark 1.2 accepts more context: 1.05M tokens versus 262K.
  • Ministral 8B has downloadable open weights; the other is API-only.

Side by side

Ministral 8B and Muse Spark 1.2 specifications
Ministral 8BMuse Spark 1.2
ProviderMistral AIMeta
Noometry Index28.250.3
Released2024-10-012026-08-05
WeightsOpenProprietary
Context window262K1.05M
Max output262K131K
Input $ / M tokens$0.15$1.25
Output $ / M tokens$0.15$4.25
Results tracked1731

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.2 leads

Ministral 8B: 35.0 (#230), Muse Spark 1.2: 49.2 (#51)

Coding benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
LMArena Coding12021495
DeepSWE—54.9%
LMArena WebDev—1533
FrontierSWE—12%
SciCode—56.4%
WeirdML—60.3%

Agentic & Tool Use Muse Spark 1.2 leads

Ministral 8B: 16.4 (#148), Muse Spark 1.2: 29.4 (#87)

Agentic & Tool Use benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
APEX-Agents—36.4%
Berkeley Function Calling Leaderboard11.1%—
GDP.pdf—16%

Reasoning Muse Spark 1.2 leads

Ministral 8B: 18.4 (#281), Muse Spark 1.2: 51.3 (#34)

Reasoning benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
LMArena Hard Prompts11911486
DTBench45.7%94.7%
SimpleBench—74.5%
NYT Connections (extended)—79.2%
CritPt—17.7%
LMCA—48.4%
Epoch Capabilities Index—154.87

Math Muse Spark 1.2 leads

Ministral 8B: 25.7 (#267), Muse Spark 1.2: 46.4 (#70)

Math benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
LMArena Math11881471
ProofBench—43%
MATH Level 514.9%—

Knowledge Muse Spark 1.2 leads

Ministral 8B: 12.6 (#297), Muse Spark 1.2: 54.1 (#53)

Knowledge benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
LMArena Expert11701480
GPQA Diamond27.1%—
SimpleQA Verified—60.3%
Vectara Hallucination Rate7.4%—

Multimodal Not comparable

Ministral 8B: —, Muse Spark 1.2: 43.4 (#25)

Multimodal benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
LMArena Vision—1305

Multilingual Muse Spark 1.2 leads

Ministral 8B: 35.1 (#247), Muse Spark 1.2: 57.1 (#11)

Multilingual benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
LMArena Non-English11651478
LMArena Chinese11931511
LMArena Russian11951487
LMArena French—1513
LMArena Spanish—1498

Instruction Following Muse Spark 1.2 leads

Ministral 8B: 60.5 (#250), Muse Spark 1.2: 76.7 (#36)

Instruction Following benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
LMArena Instruction Following11611461

Long Context Muse Spark 1.2 leads

Ministral 8B: 36.7 (#227), Muse Spark 1.2: 45.2 (#48)

Long Context benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
LMArena Longer Query12121475

Writing & Preference Muse Spark 1.2 leads

Ministral 8B: 39.6 (#246), Muse Spark 1.2: 72.3 (#14)

Writing & Preference benchmarks
BenchmarkMinistral 8BMuse Spark 1.2
LMArena Text11911482
LMArena Creative Writing11751449
LMArena Multi-Turn11661494
EQ-Bench Creative Writing—1840

Frequently asked questions

Is Ministral 8B better than Muse Spark 1.2?

Muse Spark 1.2 is the stronger model overall, scoring 50.3 to 28.2 on the Noometry Index. Ministral 8B costs 13× less per token, which makes it the better buy when Muse Spark 1.2's lead doesn't matter for your workload.

Which is cheaper, Ministral 8B or Muse Spark 1.2?

Ministral 8B is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Muse Spark 1.2 lists at $1.25 and $4.25.

Is Ministral 8B or Muse Spark 1.2 better for coding?

Muse Spark 1.2 scores higher on coding benchmarks: 49.2 versus 35.0 in the Noometry coding category.

Which has the bigger context window?

Muse Spark 1.2 does, with 1.05M tokens against 262K.

How many benchmarks do Ministral 8B and Muse Spark 1.2 share?

13 benchmarks have published results for both models. Ministral 8B has 17 scored results on Noometry and Muse Spark 1.2 has 31.

Related comparisons

Go deeper