Model comparison

Mistral Medium 3.5 vs o1-pro

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 31.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

o1-pro OpenAI

31.5

Rank #271 Reported

Summary

  • The widest gap is in knowledge, where Mistral Medium 3.5 leads 40.0 to 29.7.
  • Mistral Medium 3.5 is cheaper at $1.50 / $7.50 per million input/output tokens, against $150 / $600 for o1-pro.
  • Mistral Medium 3.5 accepts more context: 262K tokens versus 200K.
  • Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Mistral Medium 3.5 and o1-pro specifications
Mistral Medium 3.5o1-pro
ProviderMistral AIOpenAI
Noometry Index40.231.5
Released—2025-03-19
WeightsOpenProprietary
Context window262K200K
Max output210K100K
Input $ / M tokens$1.50$150
Output $ / M tokens$7.50$600
Results tracked223

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Medium 3.5: 36.0 (#213), o1-pro: —

Coding benchmarks
BenchmarkMistral Medium 3.5o1-pro
LMArena WebDev1264—
LMArena Coding1461—

Reasoning o1-pro leads

Mistral Medium 3.5: 17.3 (#295), o1-pro: 20.4 (#239)

Reasoning benchmarks
BenchmarkMistral Medium 3.5o1-pro
Kagi LLM Benchmark41.4%—
NYT Connections (extended)12.9%—
ARC-AGI-1—23.3%
EnigmaEval—6.1%
LMArena Hard Prompts1436—
Epoch Capabilities Index141.35—

Math Not comparable

Mistral Medium 3.5: 39.1 (#113), o1-pro: —

Math benchmarks
BenchmarkMistral Medium 3.5o1-pro
LMArena Math1431—

Knowledge Mistral Medium 3.5 leads

Mistral Medium 3.5: 40.0 (#126), o1-pro: 29.7 (#234)

Knowledge benchmarks
BenchmarkMistral Medium 3.5o1-pro
Humanity's Last Exam—8.1%
LMArena Expert1432—

Multimodal Not comparable

Mistral Medium 3.5: 38.3 (#65), o1-pro: —

Multimodal benchmarks
BenchmarkMistral Medium 3.5o1-pro
LMArena Vision1223—

Multilingual Not comparable

Mistral Medium 3.5: 51.9 (#100), o1-pro: —

Multilingual benchmarks
BenchmarkMistral Medium 3.5o1-pro
LMArena Non-English1404—
LMArena Chinese1442—
LMArena French1448—
LMArena German1451—
LMArena Korean1385—
LMArena Russian1395—
LMArena Spanish1409—

Instruction Following Not comparable

Mistral Medium 3.5: 74.6 (#90), o1-pro: —

Instruction Following benchmarks
BenchmarkMistral Medium 3.5o1-pro
LMArena Instruction Following1415—

Long Context Not comparable

Mistral Medium 3.5: 43.2 (#103), o1-pro: —

Long Context benchmarks
BenchmarkMistral Medium 3.5o1-pro
LMArena Longer Query1415—

Writing & Preference Not comparable

Mistral Medium 3.5: 58.5 (#117), o1-pro: —

Writing & Preference benchmarks
BenchmarkMistral Medium 3.5o1-pro
LMArena Text1421—
LMArena Creative Writing1374—
EQ-Bench 4993—
LMArena Multi-Turn1423—

Frequently asked questions

Is Mistral Medium 3.5 better than o1-pro?

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 31.5 on the Noometry Index.

Which is cheaper, Mistral Medium 3.5 or o1-pro?

Mistral Medium 3.5 is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; o1-pro lists at $150 and $600.

Which has the bigger context window?

Mistral Medium 3.5 does, with 262K tokens against 200K.

How many benchmarks do Mistral Medium 3.5 and o1-pro share?

0 benchmarks have published results for both models. Mistral Medium 3.5 has 22 scored results on Noometry and o1-pro has 3.

Related comparisons

Go deeper