Model comparison

Mercury vs Mistral Medium 3.1

Mercury is the stronger model overall, scoring 37.6 to 31.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mercury Inception

37.6

Rank #199 Confirmed

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Summary

  • The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 46.2.

Side by side

Mercury and Mistral Medium 3.1 specifications
MercuryMistral Medium 3.1
ProviderInceptionMistral AI
Noometry Index37.631.9
Released——
WeightsProprietaryProprietary
Context window—131K
Max output—105K
Input $ / M tokens—$0.40
Output $ / M tokens—$2
Results tracked93

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mercury: 38.7 (#170), Mistral Medium 3.1: —

Coding benchmarks
BenchmarkMercuryMistral Medium 3.1
LMArena Coding1322—

Reasoning Mercury leads

Mercury: 17.5 (#293), Mistral Medium 3.1: 10.6 (#341)

Reasoning benchmarks
BenchmarkMercuryMistral Medium 3.1
Kagi LLM Benchmark21.6%—
NYT Connections (extended)—6.5%
Thematic Generalization—20.3%
LMArena Hard Prompts1285—

Multilingual Not comparable

Mercury: 41.6 (#206), Mistral Medium 3.1: —

Multilingual benchmarks
BenchmarkMercuryMistral Medium 3.1
LMArena Non-English1260—

Instruction Following Not comparable

Mercury: 65.2 (#224), Mistral Medium 3.1: —

Instruction Following benchmarks
BenchmarkMercuryMistral Medium 3.1
LMArena Instruction Following1239—

Long Context Not comparable

Mercury: 38.4 (#198), Mistral Medium 3.1: —

Long Context benchmarks
BenchmarkMercuryMistral Medium 3.1
LMArena Longer Query1266—

Writing & Preference Mistral Medium 3.1 leads

Mercury: 46.2 (#221), Mistral Medium 3.1: 55.5 (#145)

Writing & Preference benchmarks
BenchmarkMercuryMistral Medium 3.1
LMArena Text1282—
LMArena Creative Writing1191—
EQ-Bench Creative Writing—1476
LMArena Multi-Turn1282—

Frequently asked questions

Is Mercury better than Mistral Medium 3.1?

Mercury is the stronger model overall, scoring 37.6 to 31.9 on the Noometry Index.

How many benchmarks do Mercury and Mistral Medium 3.1 share?

0 benchmarks have published results for both models. Mercury has 9 scored results on Noometry and Mistral Medium 3.1 has 3.

Related comparisons

Go deeper