Model comparison

GPT-5 vs Mistral Small 3.2

GPT-5 is the stronger model overall, scoring 50.9 to 31.2 on the Noometry Index. Mistral Small 3.2 costs 26× less per token, which makes it the better buy when GPT-5's lead doesn't matter for your workload.

Last verified . 6 shared benchmarks.

GPT-5 OpenAI

50.9

Rank #45 Confirmed

Mistral Small 3.2 Mistral AI

31.2

Rank #280 Confirmed

Summary

  • They share 6 benchmarks with published results for both. GPT-5 scores higher in 4 categories and Mistral Small 3.2 in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5 leads 56.6 to 26.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 91.4% for GPT-5 and 30.3% for Mistral Small 3.2.
  • Mistral Small 3.2 is cheaper at $0.0938 / $0.25 per million input/output tokens, against $1.25 / $10 for GPT-5.
  • GPT-5 accepts more context: 400K tokens versus 256K.
  • Mistral Small 3.2 has downloadable open weights; the other is API-only.

Side by side

GPT-5 and Mistral Small 3.2 specifications
GPT-5Mistral Small 3.2
ProviderOpenAIMistral AI
Noometry Index50.931.2
Released2025-08-072025-06-20
WeightsProprietaryOpen
Context window400K256K
Max output128K16K
Input $ / M tokens$1.25$0.0938
Output $ / M tokens$10$0.25
Results tracked696

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5: 50.3 (#47), Mistral Small 3.2: —

Coding benchmarks
BenchmarkGPT-5Mistral Small 3.2
SWE-bench Verified73.6%—
SWE-bench Verified (bash only)65%—
Aider Polyglot88%—
LMArena WebDev1418—
SciCode42.9%—
GSO6.9%—
WeirdML60.7%—
LMArena Coding1436—
ALE-Bench1,162—
AlgoTune1.67—

Agentic & Tool Use Not comparable

GPT-5: 33.1 (#56), Mistral Small 3.2: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5Mistral Small 3.2
Terminal-Bench49.6%—
GDPval34.8%—
Remote Labor Index1.7%—
DeepResearch Bench49.6%—
BALROG32.8%—
LMArena Search1133—
METR Time Horizons69.6%—

Reasoning GPT-5 leads

GPT-5: 38.3 (#64), Mistral Small 3.2: 18.1 (#287)

Reasoning benchmarks
BenchmarkGPT-5Mistral Small 3.2
Kagi LLM Benchmark72.7%40.4%
Chess Puzzles37%1%
Epoch Capabilities Index150131.74
ARC-AGI-29.9%—
SimpleBench56.7%—
ARC-AGI-165.7%—
CritPt12.6%—
EnigmaEval10.5%—
EBR-Bench12.7%—
LMArena Hard Prompts1416—
Mystery Game Puzzles23%—
DTBench90.7%—
LMCA40%—
ForecastBench61.4—

Math GPT-5 leads

GPT-5: 55.0 (#44), Mistral Small 3.2: 26.3 (#260)

Math benchmarks
BenchmarkGPT-5Mistral Small 3.2
OTIS Mock AIME 2024-202591.4%30.3%
FrontierMath (Tiers 1-3)55.4%—
FrontierMath Tier 422%—
ProofBench18%—
Omni-MATH64.7%—
LMArena Math1407—
MATH Level 598.1%—
FrontierMath (Feb 2025 set)32.4%—
FrontierMath Tier 4 (v1)12.5%—

Knowledge GPT-5 leads

GPT-5: 56.6 (#43), Mistral Small 3.2: 26.7 (#256)

Knowledge benchmarks
BenchmarkGPT-5Mistral Small 3.2
GPQA Diamond86.2%49.1%
Humanity's Last Exam25.3%—
SimpleQA Verified50.1%—
MMLU-Pro86.3%—
Confabulations10.3%—
Vectara Hallucination Rate14.7%—
GPQA (HELM)79.2%—
LMArena Expert1419—

Multimodal Not comparable

GPT-5: 46.8 (#13), Mistral Small 3.2: —

Multimodal benchmarks
BenchmarkGPT-5Mistral Small 3.2
LMArena Vision1232—
GeoBench81%—
VPCT66%—

Multilingual Not comparable

GPT-5: 51.4 (#110), Mistral Small 3.2: —

Multilingual benchmarks
BenchmarkGPT-5Mistral Small 3.2
LMArena Non-English1397—
LMArena Chinese1422—
LMArena French1410—
LMArena German1416—
LMArena Japanese1409—
LMArena Korean1360—
LMArena Russian1406—
LMArena Spanish1399—

Instruction Following Not comparable

GPT-5: 73.8 (#113), Mistral Small 3.2: —

Instruction Following benchmarks
BenchmarkGPT-5Mistral Small 3.2
IFEval87.5%—
LMArena Instruction Following1388—

Long Context Not comparable

GPT-5: 69.5 (#2), Mistral Small 3.2: —

Long Context benchmarks
BenchmarkGPT-5Mistral Small 3.2
Fiction.LiveBench97.2%—
LMArena Longer Query1399—

Writing & Preference GPT-5 leads

GPT-5: 63.4 (#65), Mistral Small 3.2: 45.0 (#224)

Writing & Preference benchmarks
BenchmarkGPT-5Mistral Small 3.2
EQ-Bench Creative Writing16271255
LMArena Text1406—
LMArena Creative Writing1365—
Short-Story Creative Writing86%—
WildBench85.7%—
LMArena Multi-Turn1426—

Frequently asked questions

Is GPT-5 better than Mistral Small 3.2?

GPT-5 is the stronger model overall, scoring 50.9 to 31.2 on the Noometry Index. Mistral Small 3.2 costs 26× less per token, which makes it the better buy when GPT-5's lead doesn't matter for your workload.

Which is cheaper, GPT-5 or Mistral Small 3.2?

Mistral Small 3.2 is cheaper. It lists at $0.0938 per million input tokens and $0.25 per million output tokens; GPT-5 lists at $1.25 and $10.

Which has the bigger context window?

GPT-5 does, with 400K tokens against 256K.

How many benchmarks do GPT-5 and Mistral Small 3.2 share?

6 benchmarks have published results for both models. GPT-5 has 69 scored results on Noometry and Mistral Small 3.2 has 6.

Related comparisons

Go deeper