Model comparison

Mistral vs Mistral Medium 3.1

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 29.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Mistral AI

29.9

Rank #303 Confirmed

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Summary

  • The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 37.0.

Side by side

Mistral and Mistral Medium 3.1 specifications
MistralMistral Medium 3.1
ProviderMistral AIMistral AI
Noometry Index29.931.9
Released——
WeightsProprietaryProprietary
Context window—131K
Max output—105K
Input $ / M tokens—$0.40
Output $ / M tokens—$2
Results tracked223

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral: 33.8 (#250), Mistral Medium 3.1: —

Coding benchmarks
BenchmarkMistralMistral Medium 3.1
LMArena Coding1162—

Reasoning Mistral leads

Mistral: 22.2 (#200), Mistral Medium 3.1: 10.6 (#341)

Reasoning benchmarks
BenchmarkMistralMistral Medium 3.1
NYT Connections (extended)—6.5%
Thematic Generalization—20.3%
LMArena Hard Prompts1149—

Math Not comparable

Mistral: 22.3 (#278), Mistral Medium 3.1: —

Math benchmarks
BenchmarkMistralMistral Medium 3.1
Omni-MATH7.2%—
LMArena Math1180—

Knowledge Not comparable

Mistral: 16.6 (#288), Mistral Medium 3.1: —

Knowledge benchmarks
BenchmarkMistralMistral Medium 3.1
MMLU-Pro27.7%—
GPQA (HELM)30.3%—
LMArena Expert1125—

Multilingual Not comparable

Mistral: 32.8 (#254), Mistral Medium 3.1: —

Multilingual benchmarks
BenchmarkMistralMistral Medium 3.1
LMArena Non-English1129—
LMArena Chinese1109—
LMArena French1180—
LMArena German1155—
LMArena Japanese1013—
LMArena Korean1032—
LMArena Russian1168—
LMArena Spanish1143—

Instruction Following Not comparable

Mistral: 52.6 (#288), Mistral Medium 3.1: —

Instruction Following benchmarks
BenchmarkMistralMistral Medium 3.1
IFEval56.8%—
LMArena Instruction Following1152—

Long Context Not comparable

Mistral: 35.0 (#245), Mistral Medium 3.1: —

Long Context benchmarks
BenchmarkMistralMistral Medium 3.1
LMArena Longer Query1153—

Writing & Preference Mistral Medium 3.1 leads

Mistral: 37.0 (#260), Mistral Medium 3.1: 55.5 (#145)

Writing & Preference benchmarks
BenchmarkMistralMistral Medium 3.1
LMArena Text1165—
LMArena Creative Writing1158—
EQ-Bench Creative Writing—1476
WildBench66%—
LMArena Multi-Turn1147—

Frequently asked questions

Is Mistral better than Mistral Medium 3.1?

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 29.9 on the Noometry Index.

How many benchmarks do Mistral and Mistral Medium 3.1 share?

0 benchmarks have published results for both models. Mistral has 22 scored results on Noometry and Mistral Medium 3.1 has 3.

Related comparisons

Go deeper