Model comparison

GPT-5 Pro vs Mistral

GPT-5 Pro is the stronger model overall, scoring 46.4 to 29.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5 Pro OpenAI

46.4

Rank #64 Confirmed

Mistral Mistral AI

29.9

Rank #303 Confirmed

Summary

  • The widest gap is in knowledge, where GPT-5 Pro leads 56.7 to 16.6.

Side by side

GPT-5 Pro and Mistral specifications
GPT-5 ProMistral
ProviderOpenAIMistral AI
Noometry Index46.429.9
Released2025-10-06—
WeightsProprietaryProprietary
Context window400K—
Max output272K—
Input $ / M tokens$15—
Output $ / M tokens$120—
Results tracked1222

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 Pro leads

GPT-5 Pro: 44.0 (#80), Mistral: 33.8 (#250)

Coding benchmarks
BenchmarkGPT-5 ProMistral
WeirdML60.4%—
LMArena Coding—1162
AlgoTune1.31—

Reasoning GPT-5 Pro leads

GPT-5 Pro: 38.9 (#62), Mistral: 22.2 (#200)

Reasoning benchmarks
BenchmarkGPT-5 ProMistral
ARC-AGI-218.3%—
SimpleBench61.6%—
Kagi LLM Benchmark76.8%—
ARC-AGI-170.2%—
EnigmaEval18.8%—
LMArena Hard Prompts—1149
Epoch Capabilities Index150.28—

Math GPT-5 Pro leads

GPT-5 Pro: 48.5 (#63), Mistral: 22.3 (#278)

Math benchmarks
BenchmarkGPT-5 ProMistral
FrontierMath (Tiers 1-3)55.8%—
FrontierMath Tier 419.5%—
Omni-MATH—7.2%
LMArena Math—1180
FrontierMath Tier 4 (v1)14.6%—

Knowledge GPT-5 Pro leads

GPT-5 Pro: 56.7 (#42), Mistral: 16.6 (#288)

Knowledge benchmarks
BenchmarkGPT-5 ProMistral
Humanity's Last Exam31.6%—
MMLU-Pro—27.7%
GPQA (HELM)—30.3%
LMArena Expert—1125

Multilingual Not comparable

GPT-5 Pro: —, Mistral: 32.8 (#254)

Multilingual benchmarks
BenchmarkGPT-5 ProMistral
LMArena Non-English—1129
LMArena Chinese—1109
LMArena French—1180
LMArena German—1155
LMArena Japanese—1013
LMArena Korean—1032
LMArena Russian—1168
LMArena Spanish—1143

Instruction Following Not comparable

GPT-5 Pro: —, Mistral: 52.6 (#288)

Instruction Following benchmarks
BenchmarkGPT-5 ProMistral
IFEval—56.8%
LMArena Instruction Following—1152

Long Context Not comparable

GPT-5 Pro: —, Mistral: 35.0 (#245)

Long Context benchmarks
BenchmarkGPT-5 ProMistral
LMArena Longer Query—1153

Writing & Preference Not comparable

GPT-5 Pro: —, Mistral: 37.0 (#260)

Writing & Preference benchmarks
BenchmarkGPT-5 ProMistral
LMArena Text—1165
LMArena Creative Writing—1158
WildBench—66%
LMArena Multi-Turn—1147

Frequently asked questions

Is GPT-5 Pro better than Mistral?

GPT-5 Pro is the stronger model overall, scoring 46.4 to 29.9 on the Noometry Index.

Is GPT-5 Pro or Mistral better for coding?

GPT-5 Pro scores higher on coding benchmarks: 44.0 versus 33.8 in the Noometry coding category.

How many benchmarks do GPT-5 Pro and Mistral share?

0 benchmarks have published results for both models. GPT-5 Pro has 12 scored results on Noometry and Mistral has 22.

Related comparisons

Go deeper