Model comparison

GPT-5 vs GPT-5 Pro

GPT-5 is the stronger model overall, scoring 50.9 to 46.4 on the Noometry Index.

Last verified . 12 shared benchmarks.

GPT-5 OpenAI

50.9

Rank #45 Confirmed

GPT-5 Pro OpenAI

46.4

Rank #64 Confirmed

Summary

  • They share 12 benchmarks with published results for both. GPT-5 scores higher in 2 categories and GPT-5 Pro in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5 leads 55.0 to 48.5.
  • The biggest single-benchmark swing is ARC-AGI-2: 9.9% for GPT-5 and 18.3% for GPT-5 Pro.
  • GPT-5 is cheaper at $1.25 / $10 per million input/output tokens, against $15 / $120 for GPT-5 Pro.

Side by side

GPT-5 and GPT-5 Pro specifications
GPT-5GPT-5 Pro
ProviderOpenAIOpenAI
Noometry Index50.946.4
Released2025-08-072025-10-06
WeightsProprietaryProprietary
Context window400K400K
Max output128K272K
Input $ / M tokens$1.25$15
Output $ / M tokens$10$120
Results tracked6912

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 leads

GPT-5: 50.3 (#47), GPT-5 Pro: 44.0 (#80)

Coding benchmarks
BenchmarkGPT-5GPT-5 Pro
WeirdML60.7%60.4%
AlgoTune1.671.31
SWE-bench Verified73.6%—
SWE-bench Verified (bash only)65%—
Aider Polyglot88%—
LMArena WebDev1418—
SciCode42.9%—
GSO6.9%—
LMArena Coding1436—
ALE-Bench1,162—

Agentic & Tool Use Not comparable

GPT-5: 33.1 (#56), GPT-5 Pro: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5GPT-5 Pro
Terminal-Bench49.6%—
GDPval34.8%—
Remote Labor Index1.7%—
DeepResearch Bench49.6%—
BALROG32.8%—
LMArena Search1133—
METR Time Horizons69.6%—

Reasoning Too close to call

GPT-5: 38.3 (#64), GPT-5 Pro: 38.9 (#62)

Reasoning benchmarks
BenchmarkGPT-5GPT-5 Pro
ARC-AGI-29.9%18.3%
SimpleBench56.7%61.6%
Kagi LLM Benchmark72.7%76.8%
ARC-AGI-165.7%70.2%
EnigmaEval10.5%18.8%
Epoch Capabilities Index150150.28
CritPt12.6%—
Chess Puzzles37%—
EBR-Bench12.7%—
LMArena Hard Prompts1416—
Mystery Game Puzzles23%—
DTBench90.7%—
LMCA40%—
ForecastBench61.4—

Math GPT-5 leads

GPT-5: 55.0 (#44), GPT-5 Pro: 48.5 (#63)

Math benchmarks
BenchmarkGPT-5GPT-5 Pro
FrontierMath (Tiers 1-3)55.4%55.8%
FrontierMath Tier 422%19.5%
FrontierMath Tier 4 (v1)12.5%14.6%
OTIS Mock AIME 2024-202591.4%—
ProofBench18%—
Omni-MATH64.7%—
LMArena Math1407—
MATH Level 598.1%—
FrontierMath (Feb 2025 set)32.4%—

Knowledge Too close to call

GPT-5: 56.6 (#43), GPT-5 Pro: 56.7 (#42)

Knowledge benchmarks
BenchmarkGPT-5GPT-5 Pro
Humanity's Last Exam25.3%31.6%
GPQA Diamond86.2%—
SimpleQA Verified50.1%—
MMLU-Pro86.3%—
Confabulations10.3%—
Vectara Hallucination Rate14.7%—
GPQA (HELM)79.2%—
LMArena Expert1419—

Multimodal Not comparable

GPT-5: 46.8 (#13), GPT-5 Pro: —

Multimodal benchmarks
BenchmarkGPT-5GPT-5 Pro
LMArena Vision1232—
GeoBench81%—
VPCT66%—

Multilingual Not comparable

GPT-5: 51.4 (#110), GPT-5 Pro: —

Multilingual benchmarks
BenchmarkGPT-5GPT-5 Pro
LMArena Non-English1397—
LMArena Chinese1422—
LMArena French1410—
LMArena German1416—
LMArena Japanese1409—
LMArena Korean1360—
LMArena Russian1406—
LMArena Spanish1399—

Instruction Following Not comparable

GPT-5: 73.8 (#113), GPT-5 Pro: —

Instruction Following benchmarks
BenchmarkGPT-5GPT-5 Pro
IFEval87.5%—
LMArena Instruction Following1388—

Long Context Not comparable

GPT-5: 69.5 (#2), GPT-5 Pro: —

Long Context benchmarks
BenchmarkGPT-5GPT-5 Pro
Fiction.LiveBench97.2%—
LMArena Longer Query1399—

Writing & Preference Not comparable

GPT-5: 63.4 (#65), GPT-5 Pro: —

Writing & Preference benchmarks
BenchmarkGPT-5GPT-5 Pro
LMArena Text1406—
LMArena Creative Writing1365—
Short-Story Creative Writing86%—
EQ-Bench Creative Writing1627—
WildBench85.7%—
LMArena Multi-Turn1426—

Frequently asked questions

Is GPT-5 better than GPT-5 Pro?

GPT-5 is the stronger model overall, scoring 50.9 to 46.4 on the Noometry Index.

Which is cheaper, GPT-5 or GPT-5 Pro?

GPT-5 is cheaper. It lists at $1.25 per million input tokens and $10 per million output tokens; GPT-5 Pro lists at $15 and $120.

Is GPT-5 or GPT-5 Pro better for coding?

GPT-5 scores higher on coding benchmarks: 50.3 versus 44.0 in the Noometry coding category.

Which has the bigger context window?

Both accept 400K tokens.

How many benchmarks do GPT-5 and GPT-5 Pro share?

12 benchmarks have published results for both models. GPT-5 has 69 scored results on Noometry and GPT-5 Pro has 12.

Related comparisons

Go deeper