Model comparison

Mistral Medium 3.1 vs Mistral Nemo

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 26.4 on the Noometry Index. Mistral Nemo costs 5.3× less per token, which makes it the better buy when Mistral Medium 3.1's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • They share 1 benchmark with published results for both. Mistral Medium 3.1 scores higher in 1 category and Mistral Nemo in 1 category; 2 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 28.5.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $0.40 / $2 for Mistral Medium 3.1.
  • Mistral Medium 3.1 accepts more context: 131K tokens versus 128K.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Mistral Medium 3.1 and Mistral Nemo specifications
Mistral Medium 3.1Mistral Nemo
ProviderMistral AIMistral AI
Noometry Index31.926.4
Released—2024-07-01
WeightsProprietaryOpen
Context window131K128K
Max output105K128K
Input $ / M tokens$0.40$0.15
Output $ / M tokens$2$0.15
Results tracked310

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Mistral Medium 3.1: —, Mistral Nemo: 23.5 (#125)

Agentic & Tool Use benchmarks
BenchmarkMistral Medium 3.1Mistral Nemo
Berkeley Function Calling Leaderboard—27.6%
BALROG—17.6%

Reasoning Mistral Nemo leads

Mistral Medium 3.1: 10.6 (#341), Mistral Nemo: 20.7 (#232)

Reasoning benchmarks
BenchmarkMistral Medium 3.1Mistral Nemo
NYT Connections (extended)6.5%—
Thematic Generalization20.3%—
DTBench—48.6%
Epoch Capabilities Index—118.68
PIQA—83.5%

Math Not comparable

Mistral Medium 3.1: —, Mistral Nemo: 25.5 (#268)

Math benchmarks
BenchmarkMistral Medium 3.1Mistral Nemo
MATH Level 5—10.8%
GSM8K—84.2%

Knowledge Not comparable

Mistral Medium 3.1: —, Mistral Nemo: 12.3 (#298)

Knowledge benchmarks
BenchmarkMistral Medium 3.1Mistral Nemo
GPQA Diamond—29.9%
BoolQ—82.5%

Writing & Preference Mistral Medium 3.1 leads

Mistral Medium 3.1: 55.5 (#145), Mistral Nemo: 28.5 (#296)

Writing & Preference benchmarks
BenchmarkMistral Medium 3.1Mistral Nemo
EQ-Bench Creative Writing1476881

Frequently asked questions

Is Mistral Medium 3.1 better than Mistral Nemo?

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 26.4 on the Noometry Index. Mistral Nemo costs 5.3× less per token, which makes it the better buy when Mistral Medium 3.1's lead doesn't matter for your workload.

Which is cheaper, Mistral Medium 3.1 or Mistral Nemo?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Mistral Medium 3.1 lists at $0.40 and $2.

Which has the bigger context window?

Mistral Medium 3.1 does, with 131K tokens against 128K.

How many benchmarks do Mistral Medium 3.1 and Mistral Nemo share?

1 benchmark has published results for both models. Mistral Medium 3.1 has 3 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper