Model comparison

Ministral 3B vs Muse Spark

Muse Spark is the stronger model overall, scoring 50.6 to 26.2 on the Noometry Index.

Last verified . 2 shared benchmarks.

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Muse Spark Meta

50.6

Rank #46 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Ministral 3B scores higher in 0 categories and Muse Spark in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark leads 65.7 to 10.4.
  • The biggest single-benchmark swing is GPQA Diamond: 25.3% for Ministral 3B and 89.8% for Muse Spark.
  • Ministral 3B has downloadable open weights; the other is API-only.

Side by side

Ministral 3B and Muse Spark specifications
Ministral 3BMuse Spark
ProviderMistral AIMeta
Noometry Index26.250.6
Released2024-10-012026-04-08
WeightsOpenProprietary
Context window131K—
Max output262K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.10—
Results tracked627

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Ministral 3B: —, Muse Spark: 46.2 (#69)

Coding benchmarks
BenchmarkMinistral 3BMuse Spark
SciCode—51.5%
LMArena Coding—1481

Reasoning Muse Spark leads

Ministral 3B: 18.4 (#282), Muse Spark: 35.9 (#67)

Reasoning benchmarks
BenchmarkMinistral 3BMuse Spark
Epoch Capabilities Index118.1152.04
CritPt—11.3%
LMArena Hard Prompts—1474
DTBench51.7%—
LMCA5.5%—

Math Muse Spark leads

Ministral 3B: 26.6 (#258), Muse Spark: 47.8 (#66)

Math benchmarks
BenchmarkMinistral 3BMuse Spark
OTIS Mock AIME 2024-2025—88.9%
ProofBench—17%
LMArena Math—1455
MATH Level 514.4%—
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%

Knowledge Muse Spark leads

Ministral 3B: 10.4 (#302), Muse Spark: 65.7 (#13)

Knowledge benchmarks
BenchmarkMinistral 3BMuse Spark
GPQA Diamond25.3%89.8%
Humanity's Last Exam—40.6%
Vectara Hallucination Rate7.3%—
LMArena Expert—1457

Multimodal Not comparable

Ministral 3B: —, Muse Spark: 43.4 (#24)

Multimodal benchmarks
BenchmarkMinistral 3BMuse Spark
LMArena Vision—1306
LMArena Document—1444

Multilingual Not comparable

Ministral 3B: —, Muse Spark: 56.1 (#24)

Multilingual benchmarks
BenchmarkMinistral 3BMuse Spark
LMArena Non-English—1464
LMArena Chinese—1509
LMArena French—1497
LMArena German—1497
LMArena Korean—1459
LMArena Russian—1466
LMArena Spanish—1472

Instruction Following Not comparable

Ministral 3B: —, Muse Spark: 75.9 (#51)

Instruction Following benchmarks
BenchmarkMinistral 3BMuse Spark
LMArena Instruction Following—1442

Long Context Not comparable

Ministral 3B: —, Muse Spark: 44.4 (#69)

Long Context benchmarks
BenchmarkMinistral 3BMuse Spark
LMArena Longer Query—1451

Writing & Preference Not comparable

Ministral 3B: —, Muse Spark: 66.0 (#39)

Writing & Preference benchmarks
BenchmarkMinistral 3BMuse Spark
LMArena Text—1474
LMArena Creative Writing—1459
LMArena Multi-Turn—1477

Frequently asked questions

Is Ministral 3B better than Muse Spark?

Muse Spark is the stronger model overall, scoring 50.6 to 26.2 on the Noometry Index.

How many benchmarks do Ministral 3B and Muse Spark share?

2 benchmarks have published results for both models. Ministral 3B has 6 scored results on Noometry and Muse Spark has 27.

Related comparisons

Go deeper