Noometry

Model comparison

GPT-4.5 vs Mistral Small 3

GPT-4.5 is the stronger model overall, scoring 37.2 to 31.2 on the Noometry Index.

Last verified . 21 shared benchmarks.

GPT-4.5 OpenAI

37.2

Rank #208 Confirmed

Mistral Small 3 Mistral AI

31.2

Rank #278 Confirmed

Summary

  • They share 21 benchmarks with published results for both. GPT-4.5 scores higher in 7 categories and Mistral Small 3 in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GPT-4.5 leads 56.9 to 32.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 37.8% for GPT-4.5 and 6.7% for Mistral Small 3.
  • Mistral Small 3 has downloadable open weights; the other is API-only.

Side by side

GPT-4.5Mistral Small 3
ProviderOpenAIMistral AI
Noometry Index37.231.2
Released2025-02-272025-01-30
WeightsProprietaryOpen
Context window—33K
Max output—16K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.08
Results tracked4224

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.5 leads

GPT-4.5: 42.2 (#109), Mistral Small 3: 36.5 (#207)

BenchmarkGPT-4.5Mistral Small 3
LMArena Coding13961246
Aider Polyglot44.9%—
WeirdML39.4%—
BigCodeBench Instruct—45.3%
LiveBench Coding75.2%—
BigCodeBench Complete—50.4%

Agentic & Tool Use Not comparable

GPT-4.5: 27.9 (#97), Mistral Small 3: —

BenchmarkGPT-4.5Mistral Small 3
Cybench17.5%—

Reasoning Mistral Small 3 leads

GPT-4.5: 13.9 (#330), Mistral Small 3: 18.9 (#273)

BenchmarkGPT-4.5Mistral Small 3
LMArena Hard Prompts14031233
Epoch Capabilities Index136.74127.07
ARC-AGI-20.8%—
SimpleBench34.5%—
ARC-AGI-110.3%—
Chess Puzzles—0%
EnigmaEval3.2%—
LiveBench Reasoning71.1%—
LiveBench Data Analysis64.3%—
ForecastBench61.7—
LiveBench69%—

Math GPT-4.5 leads

GPT-4.5: 32.6 (#211), Mistral Small 3: 16.3 (#295)

BenchmarkGPT-4.5Mistral Small 3
OTIS Mock AIME 2024-202537.8%6.7%
LMArena Math14121240
LiveBench Math69.3%—
MATH Level 578.6%—

Knowledge GPT-4.5 leads

GPT-4.5: 32.5 (#211), Mistral Small 3: 25.1 (#263)

BenchmarkGPT-4.5Mistral Small 3
GPQA Diamond68.7%47.3%
Confabulations13.6%25.2%
LMArena Expert13941202
Humanity's Last Exam5.4%—

Multimodal Not comparable

GPT-4.5: 37.6 (#71), Mistral Small 3: —

BenchmarkGPT-4.5Mistral Small 3
LMArena Vision1195—
VPCT45%—

Multilingual GPT-4.5 leads

GPT-4.5: 52.5 (#83), Mistral Small 3: 37.3 (#236)

BenchmarkGPT-4.5Mistral Small 3
LMArena Non-English14131198
LMArena Chinese14211204
LMArena French14181203
LMArena German14571211
LMArena Japanese14161111
LMArena Korean13921188
LMArena Russian14191216

Instruction Following GPT-4.5 leads

GPT-4.5: 72.6 (#134), Mistral Small 3: 63.7 (#229)

BenchmarkGPT-4.5Mistral Small 3
LMArena Instruction Following14041214
LiveBench Instruction Following72.3%—

Long Context GPT-4.5 leads

GPT-4.5: 40.4 (#155), Mistral Small 3: 37.8 (#211)

BenchmarkGPT-4.5Mistral Small 3
LMArena Longer Query14061246
Fiction.LiveBench63.9%—

Writing & Preference GPT-4.5 leads

GPT-4.5: 56.9 (#134), Mistral Small 3: 32.2 (#280)

BenchmarkGPT-4.5Mistral Small 3
LMArena Text14171234
LMArena Creative Writing13941195
EQ-Bench Creative Writing1258707
LMArena Multi-Turn14441217
Short-Story Creative Writing75.6%—
LiveBench Language61.5%—

Frequently asked questions

Is GPT-4.5 better than Mistral Small 3?

GPT-4.5 is the stronger model overall, scoring 37.2 to 31.2 on the Noometry Index.

Is GPT-4.5 or Mistral Small 3 better for coding?

GPT-4.5 scores higher on coding benchmarks: 42.2 versus 36.5 in the Noometry coding category.

How many benchmarks do GPT-4.5 and Mistral Small 3 share?

21 benchmarks have published results for both models. GPT-4.5 has 42 scored results on Noometry and Mistral Small 3 has 24.

Related comparisons

Go deeper