Model comparison

Mistral Large 3 vs o1-pro

Mistral Large 3 is the stronger model overall, scoring 39.1 to 31.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Large 3 Mistral AI

39.1

Rank #176 Confirmed

o1-pro OpenAI

31.5

Rank #271 Reported

Summary

  • The widest gap is in knowledge, where Mistral Large 3 leads 36.0 to 29.7.
  • Mistral Large 3 is cheaper at $0.25 / $0.75 per million input/output tokens, against $150 / $600 for o1-pro.
  • Mistral Large 3 accepts more context: 262K tokens versus 200K.
  • Mistral Large 3 has downloadable open weights; the other is API-only.

Side by side

Mistral Large 3 and o1-pro specifications
Mistral Large 3o1-pro
ProviderMistral AIOpenAI
Noometry Index39.131.5
Released2025-12-022025-03-19
WeightsOpenProprietary
Context window262K200K
Max output8K100K
Input $ / M tokens$0.25$150
Output $ / M tokens$0.75$600
Results tracked243

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Large 3: 34.4 (#237), o1-pro: —

Coding benchmarks
BenchmarkMistral Large 3o1-pro
LMArena WebDev1230—
LMArena Coding1448—

Reasoning o1-pro leads

Mistral Large 3: 15.2 (#319), o1-pro: 20.4 (#239)

Reasoning benchmarks
BenchmarkMistral Large 3o1-pro
Kagi LLM Benchmark50.9%—
NYT Connections (extended)7.5%—
ARC-AGI-1—23.3%
EnigmaEval—6.1%
Thematic Generalization23%—
LMArena Hard Prompts1429—

Math Not comparable

Mistral Large 3: 38.7 (#129), o1-pro: —

Math benchmarks
BenchmarkMistral Large 3o1-pro
LMArena Math1414—

Knowledge Mistral Large 3 leads

Mistral Large 3: 36.0 (#177), o1-pro: 29.7 (#234)

Knowledge benchmarks
BenchmarkMistral Large 3o1-pro
Humanity's Last Exam—8.1%
Vectara Hallucination Rate14.5%—
LMArena Expert1421—

Multimodal Not comparable

Mistral Large 3: 38.2 (#66), o1-pro: —

Multimodal benchmarks
BenchmarkMistral Large 3o1-pro
LMArena Vision1221—

Multilingual Not comparable

Mistral Large 3: 52.5 (#84), o1-pro: —

Multilingual benchmarks
BenchmarkMistral Large 3o1-pro
LMArena Non-English1413—
LMArena Chinese1447—
LMArena French1455—
LMArena German1437—
LMArena Japanese1394—
LMArena Korean1384—
LMArena Russian1411—
LMArena Spanish1440—

Instruction Following Not comparable

Mistral Large 3: 74.0 (#108), o1-pro: —

Instruction Following benchmarks
BenchmarkMistral Large 3o1-pro
LMArena Instruction Following1403—

Long Context Not comparable

Mistral Large 3: 43.1 (#105), o1-pro: —

Long Context benchmarks
BenchmarkMistral Large 3o1-pro
LMArena Longer Query1413—

Writing & Preference Not comparable

Mistral Large 3: 60.0 (#101), o1-pro: —

Writing & Preference benchmarks
BenchmarkMistral Large 3o1-pro
LMArena Text1428—
LMArena Creative Writing1386—
EQ-Bench Creative Writing1412—
LMArena Multi-Turn1429—

Frequently asked questions

Is Mistral Large 3 better than o1-pro?

Mistral Large 3 is the stronger model overall, scoring 39.1 to 31.5 on the Noometry Index.

Which is cheaper, Mistral Large 3 or o1-pro?

Mistral Large 3 is cheaper. It lists at $0.25 per million input tokens and $0.75 per million output tokens; o1-pro lists at $150 and $600.

Which has the bigger context window?

Mistral Large 3 does, with 262K tokens against 200K.

How many benchmarks do Mistral Large 3 and o1-pro share?

0 benchmarks have published results for both models. Mistral Large 3 has 24 scored results on Noometry and o1-pro has 3.

Related comparisons

Go deeper