Model comparison

Mistral Medium 3.1 vs Olmo 3.1 32b Think

Olmo 3.1 32b Think is the stronger model overall, scoring 37.9 to 31.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Summary

  • The widest gap is in reasoning, where Olmo 3.1 32b Think leads 25.2 to 10.6.
  • Olmo 3.1 32b Think has downloadable open weights; the other is API-only.

Side by side

Mistral Medium 3.1 and Olmo 3.1 32b Think specifications
Mistral Medium 3.1Olmo 3.1 32b Think
ProviderMistral AIAllen Institute for AI (Ai2)
Noometry Index31.937.9
Released——
WeightsProprietaryOpen
Context window131K—
Max output105K—
Input $ / M tokens$0.40—
Output $ / M tokens$2—
Results tracked315

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Medium 3.1: —, Olmo 3.1 32b Think: 37.7 (#189)

Coding benchmarks
BenchmarkMistral Medium 3.1Olmo 3.1 32b Think
LMArena Coding—1291

Reasoning Olmo 3.1 32b Think leads

Mistral Medium 3.1: 10.6 (#341), Olmo 3.1 32b Think: 25.2 (#150)

Reasoning benchmarks
BenchmarkMistral Medium 3.1Olmo 3.1 32b Think
NYT Connections (extended)6.5%—
Thematic Generalization20.3%—
LMArena Hard Prompts—1272

Math Not comparable

Mistral Medium 3.1: —, Olmo 3.1 32b Think: 36.3 (#168)

Math benchmarks
BenchmarkMistral Medium 3.1Olmo 3.1 32b Think
LMArena Math—1305

Knowledge Not comparable

Mistral Medium 3.1: —, Olmo 3.1 32b Think: 35.7 (#181)

Knowledge benchmarks
BenchmarkMistral Medium 3.1Olmo 3.1 32b Think
LMArena Expert—1295

Multilingual Not comparable

Mistral Medium 3.1: —, Olmo 3.1 32b Think: 38.1 (#231)

Multilingual benchmarks
BenchmarkMistral Medium 3.1Olmo 3.1 32b Think
LMArena Non-English—1209
LMArena Chinese—1242
LMArena French—1260
LMArena German—1262
LMArena Russian—1193
LMArena Spanish—1289

Instruction Following Not comparable

Mistral Medium 3.1: —, Olmo 3.1 32b Think: 65.6 (#218)

Instruction Following benchmarks
BenchmarkMistral Medium 3.1Olmo 3.1 32b Think
LMArena Instruction Following—1247

Long Context Not comparable

Mistral Medium 3.1: —, Olmo 3.1 32b Think: 38.6 (#195)

Long Context benchmarks
BenchmarkMistral Medium 3.1Olmo 3.1 32b Think
LMArena Longer Query—1272

Writing & Preference Mistral Medium 3.1 leads

Mistral Medium 3.1: 55.5 (#145), Olmo 3.1 32b Think: 46.2 (#220)

Writing & Preference benchmarks
BenchmarkMistral Medium 3.1Olmo 3.1 32b Think
LMArena Text—1272
LMArena Creative Writing—1226
EQ-Bench Creative Writing1476—
LMArena Multi-Turn—1252

Frequently asked questions

Is Mistral Medium 3.1 better than Olmo 3.1 32b Think?

Olmo 3.1 32b Think is the stronger model overall, scoring 37.9 to 31.9 on the Noometry Index.

How many benchmarks do Mistral Medium 3.1 and Olmo 3.1 32b Think share?

0 benchmarks have published results for both models. Mistral Medium 3.1 has 3 scored results on Noometry and Olmo 3.1 32b Think has 15.

Related comparisons

Go deeper