Model comparison

Mistral Large vs Muse Spark 1.2

Muse Spark 1.2 is the stronger model overall, scoring 50.3 to 31.9 on the Noometry Index.

Last verified . 21 shared benchmarks.

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Muse Spark 1.2 Meta

50.3

Rank #48 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Mistral Large scores higher in 0 categories and Muse Spark 1.2 in 9 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Muse Spark 1.2 leads 51.3 to 15.8.
  • The biggest single-benchmark swing is SimpleBench: 22.5% for Mistral Large and 74.5% for Muse Spark 1.2.
  • Muse Spark 1.2 is cheaper at $1.25 / $4.25 per million input/output tokens, against $2 / $6 for Mistral Large.
  • Muse Spark 1.2 accepts more context: 1.05M tokens versus 131K.
  • Mistral Large has downloadable open weights; the other is API-only.

Side by side

Mistral Large and Muse Spark 1.2 specifications
Mistral LargeMuse Spark 1.2
ProviderMistral AIMeta
Noometry Index31.950.3
Released2024-02-262026-08-05
WeightsOpenProprietary
Context window131K1.05M
Max output16K131K
Input $ / M tokens$2$1.25
Output $ / M tokens$6$4.25
Results tracked5131

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.2 leads

Mistral Large: 34.3 (#240), Muse Spark 1.2: 49.2 (#51)

Coding benchmarks
BenchmarkMistral LargeMuse Spark 1.2
SciCode36.2%56.4%
LMArena Coding12771495
DeepSWE—54.9%
LMArena WebDev—1533
FrontierSWE—12%
WeirdML—60.3%
BigCodeBench Instruct30%—
LiveBench Coding47.1%—
BigCodeBench Complete38.3%—
ALE-Bench264.7—
HumanEval+62.2%—
MBPP+59.5%—

Agentic & Tool Use Too close to call

Mistral Large: 28.6 (#89), Muse Spark 1.2: 29.4 (#87)

Agentic & Tool Use benchmarks
BenchmarkMistral LargeMuse Spark 1.2
APEX-Agents—36.4%
Berkeley Function Calling Leaderboard38.4%—
GDP.pdf—16%

Reasoning Muse Spark 1.2 leads

Mistral Large: 15.8 (#310), Muse Spark 1.2: 51.3 (#34)

Reasoning benchmarks
BenchmarkMistral LargeMuse Spark 1.2
SimpleBench22.5%74.5%
CritPt0%17.7%
LMArena Hard Prompts12571486
DTBench65.1%94.7%
LMCA16.7%48.4%
Epoch Capabilities Index128.52154.87
NYT Connections (extended)—79.2%
LiveBench Reasoning43.5%—
LiveBench Data Analysis50.1%—
ForecastBench57.1—
LiveBench48.4%—

Math Muse Spark 1.2 leads

Mistral Large: 18.2 (#291), Muse Spark 1.2: 46.4 (#70)

Math benchmarks
BenchmarkMistral LargeMuse Spark 1.2
LMArena Math12621471
OTIS Mock AIME 2024-20258.5%—
ProofBench—43%
Omni-MATH28.1%—
LiveBench Math42.5%—
MATH Level 550.3%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Muse Spark 1.2 leads

Mistral Large: 30.1 (#230), Muse Spark 1.2: 54.1 (#53)

Knowledge benchmarks
BenchmarkMistral LargeMuse Spark 1.2
LMArena Expert12321480
GPQA Diamond51.3%—
SimpleQA Verified—60.3%
MMLU-Pro59.9%—
Confabulations21.4%—
Vectara Hallucination Rate4.5%—
GPQA (HELM)43.5%—
MMLU80%—

Multimodal Not comparable

Mistral Large: —, Muse Spark 1.2: 43.4 (#25)

Multimodal benchmarks
BenchmarkMistral LargeMuse Spark 1.2
LMArena Vision—1305

Multilingual Muse Spark 1.2 leads

Mistral Large: 40.0 (#219), Muse Spark 1.2: 57.1 (#11)

Multilingual benchmarks
BenchmarkMistral LargeMuse Spark 1.2
LMArena Non-English12371478
LMArena Chinese12401511
LMArena French13251513
LMArena Russian12571487
LMArena Spanish12681498
LMArena German1254—
LMArena Japanese1188—
LMArena Korean1202—

Instruction Following Muse Spark 1.2 leads

Mistral Large: 67.9 (#191), Muse Spark 1.2: 76.7 (#36)

Instruction Following benchmarks
BenchmarkMistral LargeMuse Spark 1.2
LMArena Instruction Following12491461
LiveBench Instruction Following67.9%—
IFEval87.7%—

Long Context Muse Spark 1.2 leads

Mistral Large: 38.3 (#199), Muse Spark 1.2: 45.2 (#48)

Long Context benchmarks
BenchmarkMistral LargeMuse Spark 1.2
LMArena Longer Query12611475

Writing & Preference Muse Spark 1.2 leads

Mistral Large: 40.7 (#242), Muse Spark 1.2: 72.3 (#14)

Writing & Preference benchmarks
BenchmarkMistral LargeMuse Spark 1.2
LMArena Text12661482
LMArena Creative Writing12431449
EQ-Bench Creative Writing9851840
LMArena Multi-Turn12601494
Short-Story Creative Writing69%—
WildBench80.1%—
LiveBench Language39.4%—

Frequently asked questions

Is Mistral Large better than Muse Spark 1.2?

Muse Spark 1.2 is the stronger model overall, scoring 50.3 to 31.9 on the Noometry Index.

Which is cheaper, Mistral Large or Muse Spark 1.2?

Muse Spark 1.2 is cheaper. It lists at $1.25 per million input tokens and $4.25 per million output tokens; Mistral Large lists at $2 and $6.

Is Mistral Large or Muse Spark 1.2 better for coding?

Muse Spark 1.2 scores higher on coding benchmarks: 49.2 versus 34.3 in the Noometry coding category.

Which has the bigger context window?

Muse Spark 1.2 does, with 1.05M tokens against 131K.

How many benchmarks do Mistral Large and Muse Spark 1.2 share?

21 benchmarks have published results for both models. Mistral Large has 51 scored results on Noometry and Muse Spark 1.2 has 31.

Related comparisons

Go deeper