Noometry

Model comparison

GPT-5.4 Pro vs GPT-6.1 Sol

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 58.9 on the Noometry Index.

Last verified . 9 shared benchmarks.

GPT-5.4 Pro OpenAI

58.9

Rank #18 Confirmed

GPT-6.1 Sol OpenAI

65.6

Rank #6 Confirmed

Summary

  • They share 9 benchmarks with published results for both. GPT-5.4 Pro scores higher in 0 categories and GPT-6.1 Sol in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-6.1 Sol leads 93.7 to 72.4.
  • The biggest single-benchmark swing is FrontierMath Tier 4: 58.5% for GPT-5.4 Pro and 100% for GPT-6.1 Sol.
  • GPT-6.1 Sol is cheaper at $2 / $10 per million input/output tokens, against $30 / $180 for GPT-5.4 Pro.

Side by side

GPT-5.4 ProGPT-6.1 Sol
ProviderOpenAIOpenAI
Noometry Index58.965.6
Released2026-03-052026-09-29
WeightsProprietaryProprietary
Context window1.05M1.05M
Max output128K128K
Input $ / M tokens$30$2
Output $ / M tokens$180$10
Results tracked1634

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6.1 Sol leads

GPT-5.4 Pro: 43.2 (#90), GPT-6.1 Sol: 63.2 (#8)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
DeepSWE—75.2%
FrontierCode—50.2%
LMArena WebDev—1755
SciCode—55.8%
WeirdML57.4%—
LMArena Coding—1487

Agentic & Tool Use Not comparable

GPT-5.4 Pro: —, GPT-6.1 Sol: 39.6 (#26)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
APEX-Agents—60%
GDP.pdf—32%

Reasoning GPT-6.1 Sol leads

GPT-5.4 Pro: 70.7 (#13), GPT-6.1 Sol: 81.9 (#2)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
ARC-AGI-283.3%94.2%
ARC-AGI-194.5%98.5%
CritPt30%31.7%
Chess Puzzles58.6%61%
Epoch Capabilities Index158.93166.09
SimpleBench74.1%—
NYT Connections (extended)—95.5%
EnigmaEval23.8%—
EBR-Bench—54.3%
LMArena Hard Prompts—1466
Mystery Game Puzzles—80%

Math GPT-6.1 Sol leads

GPT-5.4 Pro: 72.4 (#22), GPT-6.1 Sol: 93.7 (#1)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
FrontierMath (Tiers 1-3)82.5%93.7%
FrontierMath Tier 458.5%100%
OTIS Mock AIME 2024-2025—100%
ProofBench—99%
LMArena Math—1464
FrontierMath (Feb 2025 set)50%—
FrontierMath Tier 4 (v1)37.5%—

Knowledge GPT-6.1 Sol leads

GPT-5.4 Pro: 68.3 (#7), GPT-6.1 Sol: 71.8 (#4)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
GPQA Diamond94.6%95.4%
SimpleQA Verified46.3%73.9%
Humanity's Last Exam44.3%—
Vectara Hallucination Rate8.3%—
LMArena Expert—1502

Multimodal Not comparable

GPT-5.4 Pro: —, GPT-6.1 Sol: 52.7 (#5)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
LMArena Vision—1288
Furniture Assembly—80%

Multilingual Not comparable

GPT-5.4 Pro: —, GPT-6.1 Sol: 54.3 (#46)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
LMArena Non-English—1438
LMArena Chinese—1477
LMArena Russian—1455

Instruction Following Not comparable

GPT-5.4 Pro: —, GPT-6.1 Sol: 77.0 (#29)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
LMArena Instruction Following—1468

Long Context Not comparable

GPT-5.4 Pro: —, GPT-6.1 Sol: 44.9 (#54)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
LMArena Longer Query—1465

Writing & Preference Not comparable

GPT-5.4 Pro: —, GPT-6.1 Sol: 63.6 (#63)

BenchmarkGPT-5.4 ProGPT-6.1 Sol
LMArena Text—1447
LMArena Creative Writing—1432
LMArena Multi-Turn—1449

Frequently asked questions

Is GPT-5.4 Pro better than GPT-6.1 Sol?

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 58.9 on the Noometry Index.

Which is cheaper, GPT-5.4 Pro or GPT-6.1 Sol?

GPT-6.1 Sol is cheaper. It lists at $2 per million input tokens and $10 per million output tokens; GPT-5.4 Pro lists at $30 and $180.

Is GPT-5.4 Pro or GPT-6.1 Sol better for coding?

GPT-6.1 Sol scores higher on coding benchmarks: 63.2 versus 43.2 in the Noometry coding category.

Which has the bigger context window?

Both accept 1.05M tokens.

How many benchmarks do GPT-5.4 Pro and GPT-6.1 Sol share?

9 benchmarks have published results for both models. GPT-5.4 Pro has 16 scored results on Noometry and GPT-6.1 Sol has 34.

Related comparisons

Go deeper