Model comparison

Mistral Large vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 31.9 on the Noometry Index.

Last verified . 23 shared benchmarks.

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Mistral Large scores higher in 0 categories and Muse Spark 1.1 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Muse Spark 1.1 leads 73.4 to 40.7.
  • The biggest single-benchmark swing is LMCA: 16.7% for Mistral Large and 49.9% for Muse Spark 1.1.
  • Muse Spark 1.1 is cheaper at $1.25 / $4.25 per million input/output tokens, against $2 / $6 for Mistral Large.
  • Muse Spark 1.1 accepts more context: 1.05M tokens versus 131K.
  • Mistral Large has downloadable open weights; the other is API-only.

Side by side

Mistral Large and Muse Spark 1.1 specifications
Mistral LargeMuse Spark 1.1
ProviderMistral AIMeta
Noometry Index31.949.9
Released2024-02-262026-04-08
WeightsOpenProprietary
Context window131K1.05M
Max output16K131K
Input $ / M tokens$2$1.25
Output $ / M tokens$6$4.25
Results tracked5137

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Mistral Large: 34.3 (#240), Muse Spark 1.1: 51.3 (#40)

Coding benchmarks
BenchmarkMistral LargeMuse Spark 1.1
SciCode36.2%58.8%
LMArena Coding12771498
DeepSWE—53.3%
LMArena WebDev—1542
BigCodeBench Instruct30%—
LiveBench Coding47.1%—
BigCodeBench Complete38.3%—
ALE-Bench264.7—
HumanEval+62.2%—
MBPP+59.5%—

Agentic & Tool Use Muse Spark 1.1 leads

Mistral Large: 28.6 (#89), Muse Spark 1.1: 30.8 (#73)

Agentic & Tool Use benchmarks
BenchmarkMistral LargeMuse Spark 1.1
APEX-Agents—31.8%
Berkeley Function Calling Leaderboard38.4%—
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Mistral Large: 15.8 (#310), Muse Spark 1.1: 47.1 (#44)

Reasoning benchmarks
BenchmarkMistral LargeMuse Spark 1.1
CritPt0%15.1%
LMArena Hard Prompts12571486
DTBench65.1%94.4%
LMCA16.7%49.9%
Epoch Capabilities Index128.52154.21
SimpleBench22.5%—
NYT Connections (extended)—84.9%
LiveBench Reasoning43.5%—
LiveBench Data Analysis50.1%—
Surface Evolver Bench—52.5%
ForecastBench57.1—
LiveBench48.4%—

Math Muse Spark 1.1 leads

Mistral Large: 18.2 (#291), Muse Spark 1.1: 45.5 (#76)

Math benchmarks
BenchmarkMistral LargeMuse Spark 1.1
LMArena Math12621483
OTIS Mock AIME 2024-20258.5%—
ProofBench—39%
Omni-MATH28.1%—
LiveBench Math42.5%—
MATH Level 550.3%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Muse Spark 1.1 leads

Mistral Large: 30.1 (#230), Muse Spark 1.1: 53.1 (#59)

Knowledge benchmarks
BenchmarkMistral LargeMuse Spark 1.1
LMArena Expert12321478
GPQA Diamond51.3%—
SimpleQA Verified—57.8%
MMLU-Pro59.9%—
Confabulations21.4%—
Vectara Hallucination Rate4.5%—
GPQA (HELM)43.5%—
MMLU80%—

Multimodal Not comparable

Mistral Large: —, Muse Spark 1.1: 42.6 (#29)

Multimodal benchmarks
BenchmarkMistral LargeMuse Spark 1.1
LMArena Vision—1293
LMArena Document—1465

Multilingual Muse Spark 1.1 leads

Mistral Large: 40.0 (#219), Muse Spark 1.1: 56.7 (#17)

Multilingual benchmarks
BenchmarkMistral LargeMuse Spark 1.1
LMArena Non-English12371472
LMArena Chinese12401518
LMArena French13251494
LMArena German12541466
LMArena Japanese11881451
LMArena Korean12021458
LMArena Russian12571483
LMArena Spanish12681464

Instruction Following Muse Spark 1.1 leads

Mistral Large: 67.9 (#191), Muse Spark 1.1: 76.5 (#39)

Instruction Following benchmarks
BenchmarkMistral LargeMuse Spark 1.1
LMArena Instruction Following12491457
LiveBench Instruction Following67.9%—
IFEval87.7%—

Long Context Muse Spark 1.1 leads

Mistral Large: 38.3 (#199), Muse Spark 1.1: 44.8 (#58)

Long Context benchmarks
BenchmarkMistral LargeMuse Spark 1.1
LMArena Longer Query12611462

Writing & Preference Muse Spark 1.1 leads

Mistral Large: 40.7 (#242), Muse Spark 1.1: 73.4 (#11)

Writing & Preference benchmarks
BenchmarkMistral LargeMuse Spark 1.1
LMArena Text12661479
LMArena Creative Writing12431437
EQ-Bench Creative Writing9851927
LMArena Multi-Turn12601485
Short-Story Creative Writing69%—
WildBench80.1%—
EQ-Bench 4—1260
LiveBench Language39.4%—

Frequently asked questions

Is Mistral Large better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 31.9 on the Noometry Index.

Which is cheaper, Mistral Large or Muse Spark 1.1?

Muse Spark 1.1 is cheaper. It lists at $1.25 per million input tokens and $4.25 per million output tokens; Mistral Large lists at $2 and $6.

Is Mistral Large or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 51.3 versus 34.3 in the Noometry coding category.

Which has the bigger context window?

Muse Spark 1.1 does, with 1.05M tokens against 131K.

How many benchmarks do Mistral Large and Muse Spark 1.1 share?

23 benchmarks have published results for both models. Mistral Large has 51 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper