Model comparison

Mistral Large vs Mistral Medium 3.1

Mistral Large and Mistral Medium 3.1 score almost the same on the Noometry Index (31.9 vs 31.9), so choose on price, context window or the category you care about most.

Last verified . 1 shared benchmarks.

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Summary

  • They share 1 benchmark with published results for both. Mistral Large scores higher in 1 category and Mistral Medium 3.1 in 1 category; 2 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 40.7.
  • Mistral Medium 3.1 is cheaper at $0.40 / $2 per million input/output tokens, against $2 / $6 for Mistral Large.
  • Mistral Large has downloadable open weights; the other is API-only.

Side by side

Mistral Large and Mistral Medium 3.1 specifications
Mistral LargeMistral Medium 3.1
ProviderMistral AIMistral AI
Noometry Index31.931.9
Released2024-02-26—
WeightsOpenProprietary
Context window131K131K
Max output16K105K
Input $ / M tokens$2$0.40
Output $ / M tokens$6$2
Results tracked513

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Large: 34.3 (#240), Mistral Medium 3.1: —

Coding benchmarks
BenchmarkMistral LargeMistral Medium 3.1
SciCode36.2%—
BigCodeBench Instruct30%—
LiveBench Coding47.1%—
LMArena Coding1277—
BigCodeBench Complete38.3%—
ALE-Bench264.7—
HumanEval+62.2%—
MBPP+59.5%—

Agentic & Tool Use Not comparable

Mistral Large: 28.6 (#89), Mistral Medium 3.1: —

Agentic & Tool Use benchmarks
BenchmarkMistral LargeMistral Medium 3.1
Berkeley Function Calling Leaderboard38.4%—

Reasoning Mistral Large leads

Mistral Large: 15.8 (#310), Mistral Medium 3.1: 10.6 (#341)

Reasoning benchmarks
BenchmarkMistral LargeMistral Medium 3.1
SimpleBench22.5%—
NYT Connections (extended)—6.5%
CritPt0%—
Thematic Generalization—20.3%
LiveBench Reasoning43.5%—
LMArena Hard Prompts1257—
DTBench65.1%—
LiveBench Data Analysis50.1%—
LMCA16.7%—
Epoch Capabilities Index128.52—
ForecastBench57.1—
LiveBench48.4%—

Math Not comparable

Mistral Large: 18.2 (#291), Mistral Medium 3.1: —

Math benchmarks
BenchmarkMistral LargeMistral Medium 3.1
OTIS Mock AIME 2024-20258.5%—
Omni-MATH28.1%—
LiveBench Math42.5%—
LMArena Math1262—
MATH Level 550.3%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Not comparable

Mistral Large: 30.1 (#230), Mistral Medium 3.1: —

Knowledge benchmarks
BenchmarkMistral LargeMistral Medium 3.1
GPQA Diamond51.3%—
MMLU-Pro59.9%—
Confabulations21.4%—
Vectara Hallucination Rate4.5%—
GPQA (HELM)43.5%—
LMArena Expert1232—
MMLU80%—

Multilingual Not comparable

Mistral Large: 40.0 (#219), Mistral Medium 3.1: —

Multilingual benchmarks
BenchmarkMistral LargeMistral Medium 3.1
LMArena Non-English1237—
LMArena Chinese1240—
LMArena French1325—
LMArena German1254—
LMArena Japanese1188—
LMArena Korean1202—
LMArena Russian1257—
LMArena Spanish1268—

Instruction Following Not comparable

Mistral Large: 67.9 (#191), Mistral Medium 3.1: —

Instruction Following benchmarks
BenchmarkMistral LargeMistral Medium 3.1
LiveBench Instruction Following67.9%—
IFEval87.7%—
LMArena Instruction Following1249—

Long Context Not comparable

Mistral Large: 38.3 (#199), Mistral Medium 3.1: —

Long Context benchmarks
BenchmarkMistral LargeMistral Medium 3.1
LMArena Longer Query1261—

Writing & Preference Mistral Medium 3.1 leads

Mistral Large: 40.7 (#242), Mistral Medium 3.1: 55.5 (#145)

Writing & Preference benchmarks
BenchmarkMistral LargeMistral Medium 3.1
EQ-Bench Creative Writing9851476
LMArena Text1266—
LMArena Creative Writing1243—
Short-Story Creative Writing69%—
WildBench80.1%—
LMArena Multi-Turn1260—
LiveBench Language39.4%—

Frequently asked questions

Is Mistral Large better than Mistral Medium 3.1?

Mistral Large and Mistral Medium 3.1 score almost the same on the Noometry Index (31.9 vs 31.9), so choose on price, context window or the category you care about most.

Which is cheaper, Mistral Large or Mistral Medium 3.1?

Mistral Medium 3.1 is cheaper. It lists at $0.40 per million input tokens and $2 per million output tokens; Mistral Large lists at $2 and $6.

Which has the bigger context window?

Both accept 131K tokens.

How many benchmarks do Mistral Large and Mistral Medium 3.1 share?

1 benchmark has published results for both models. Mistral Large has 51 scored results on Noometry and Mistral Medium 3.1 has 3.

Related comparisons

Go deeper