Model comparison

Ministral 3B vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 26.2 on the Noometry Index. Ministral 3B costs 20× less per token, which makes it the better buy when Muse Spark 1.1's lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Ministral 3B scores higher in 0 categories and Muse Spark 1.1 in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark 1.1 leads 53.1 to 10.4.
  • The biggest single-benchmark swing is LMCA: 5.5% for Ministral 3B and 49.9% for Muse Spark 1.1.
  • Ministral 3B is cheaper at $0.10 / $0.10 per million input/output tokens, against $1.25 / $4.25 for Muse Spark 1.1.
  • Muse Spark 1.1 accepts more context: 1.05M tokens versus 131K.
  • Ministral 3B has downloadable open weights; the other is API-only.

Side by side

Ministral 3B and Muse Spark 1.1 specifications
Ministral 3BMuse Spark 1.1
ProviderMistral AIMeta
Noometry Index26.249.9
Released2024-10-012026-04-08
WeightsOpenProprietary
Context window131K1.05M
Max output262K131K
Input $ / M tokens$0.10$1.25
Output $ / M tokens$0.10$4.25
Results tracked637

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Ministral 3B: —, Muse Spark 1.1: 51.3 (#40)

Coding benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%
LMArena Coding—1498

Agentic & Tool Use Not comparable

Ministral 3B: —, Muse Spark 1.1: 30.8 (#73)

Agentic & Tool Use benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
APEX-Agents—31.8%
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Ministral 3B: 18.4 (#282), Muse Spark 1.1: 47.1 (#44)

Reasoning benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
DTBench51.7%94.4%
LMCA5.5%49.9%
Epoch Capabilities Index118.1154.21
NYT Connections (extended)—84.9%
CritPt—15.1%
LMArena Hard Prompts—1486
Surface Evolver Bench—52.5%

Math Muse Spark 1.1 leads

Ministral 3B: 26.6 (#258), Muse Spark 1.1: 45.5 (#76)

Math benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
ProofBench—39%
LMArena Math—1483
MATH Level 514.4%—

Knowledge Muse Spark 1.1 leads

Ministral 3B: 10.4 (#302), Muse Spark 1.1: 53.1 (#59)

Knowledge benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
GPQA Diamond25.3%—
SimpleQA Verified—57.8%
Vectara Hallucination Rate7.3%—
LMArena Expert—1478

Multimodal Not comparable

Ministral 3B: —, Muse Spark 1.1: 42.6 (#29)

Multimodal benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
LMArena Vision—1293
LMArena Document—1465

Multilingual Not comparable

Ministral 3B: —, Muse Spark 1.1: 56.7 (#17)

Multilingual benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
LMArena Non-English—1472
LMArena Chinese—1518
LMArena French—1494
LMArena German—1466
LMArena Japanese—1451
LMArena Korean—1458
LMArena Russian—1483
LMArena Spanish—1464

Instruction Following Not comparable

Ministral 3B: —, Muse Spark 1.1: 76.5 (#39)

Instruction Following benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
LMArena Instruction Following—1457

Long Context Not comparable

Ministral 3B: —, Muse Spark 1.1: 44.8 (#58)

Long Context benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
LMArena Longer Query—1462

Writing & Preference Not comparable

Ministral 3B: —, Muse Spark 1.1: 73.4 (#11)

Writing & Preference benchmarks
BenchmarkMinistral 3BMuse Spark 1.1
LMArena Text—1479
LMArena Creative Writing—1437
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260
LMArena Multi-Turn—1485

Frequently asked questions

Is Ministral 3B better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 26.2 on the Noometry Index. Ministral 3B costs 20× less per token, which makes it the better buy when Muse Spark 1.1's lead doesn't matter for your workload.

Which is cheaper, Ministral 3B or Muse Spark 1.1?

Ministral 3B is cheaper. It lists at $0.10 per million input tokens and $0.10 per million output tokens; Muse Spark 1.1 lists at $1.25 and $4.25.

Which has the bigger context window?

Muse Spark 1.1 does, with 1.05M tokens against 131K.

How many benchmarks do Ministral 3B and Muse Spark 1.1 share?

3 benchmarks have published results for both models. Ministral 3B has 6 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper