Model comparison

GPT-5.6 Sol vs Step 5 Preview

GPT-5.6 Sol is the stronger model overall, scoring 65.0 to 47.9 on the Noometry Index. Step 5 Preview costs 5.6× less per token, which makes it the better buy when GPT-5.6 Sol's lead doesn't matter for your workload.

Last verified . 18 shared benchmarks.

GPT-5.6 Sol OpenAI

65.0

Rank #7 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 18 benchmarks with published results for both. GPT-5.6 Sol scores higher in 9 categories and Step 5 Preview in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Sol leads 85.6 to 46.1.
  • The biggest single-benchmark swing is ProofBench: 83% for GPT-5.6 Sol and 42% for Step 5 Preview.
  • Step 5 Preview is cheaper at $1 / $2.70 per million input/output tokens, against $4 / $20 for GPT-5.6 Sol.
  • GPT-5.6 Sol accepts more context: 1.05M tokens versus 1.02M.

Side by side

GPT-5.6 Sol and Step 5 Preview specifications
GPT-5.6 SolStep 5 Preview
ProviderOpenAIStepFun
Noometry Index65.047.9
Released2026-07-092026-09-16
WeightsProprietaryProprietary
Context window1.05M1.02M
Max output128K66K
Input $ / M tokens$4$1
Output $ / M tokens$20$2.70
Results tracked6518

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Sol leads

GPT-5.6 Sol: 65.1 (#7), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
LMArena WebDev16181564
SciCode57.1%58.9%
LMArena Coding14981480
DeepSWE72.7%—
FrontierCode47.5%—
CursorBench41.7%—
FrontierSWE32.2%—
GSO76.5%—
WeirdML89.4%—
MirrorCode20%—
ALE-Bench2,177—

Agentic & Tool Use Not comparable

GPT-5.6 Sol: 50.3 (#7), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
APEX-Agents51.4%—
OSWorld 2.027.3%—
τ²-bench Banking46.9%—
PostTrainBench36.2%—
BALROG60%—
GBAEval52.6%—
GDP.pdf30.7%—
LMArena Search1257—
Vending-Bench 29,619—

Reasoning GPT-5.6 Sol leads

GPT-5.6 Sol: 74.8 (#8), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
CritPt32.3%20.9%
LMArena Hard Prompts14841465
ARC-AGI-292.5%—
SimpleBench71.7%—
Kagi LLM Benchmark67%—
NYT Connections (extended)93.8%—
ARC-AGI-197.5%—
Chess Puzzles64%—
EnigmaEval37.1%—
EBR-Bench44.8%—
Mystery Game Puzzles58%—
DTBench96%—
LMCA59.2%—
Surface Evolver Bench93.1%—
Bench to the Future 30.14—
Epoch Capabilities Index161.66—

Math GPT-5.6 Sol leads

GPT-5.6 Sol: 85.6 (#9), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
ProofBench83%42%
LMArena Math14741470
FrontierMath (Tiers 1-3)89.1%—
FrontierMath Tier 482.9%—
OTIS Mock AIME 2024-2025100%—
FrontierMath Erdős0%—

Knowledge GPT-5.6 Sol leads

GPT-5.6 Sol: 64.3 (#18), Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
LMArena Expert15161470
GPQA Diamond93.5%—
SimpleQA Verified69.7%—
Vectara Hallucination Rate12.4%—

Multimodal GPT-5.6 Sol leads

GPT-5.6 Sol: 48.6 (#9), Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
LMArena Vision12811267
Blueprint-Bench 233.6%—
Furniture Assembly56.7%—
LMArena Document1483—

Multilingual GPT-5.6 Sol leads

GPT-5.6 Sol: 55.3 (#32), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
LMArena Non-English14521432
LMArena Chinese15271519
LMArena Russian14681436
LMArena Spanish14411439
LMArena French1477—
LMArena German1476—
LMArena Japanese1471—
LMArena Korean1442—

Instruction Following GPT-5.6 Sol leads

GPT-5.6 Sol: 77.7 (#16), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
LMArena Instruction Following14821444

Long Context Too close to call

GPT-5.6 Sol: 45.4 (#42), Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
LMArena Longer Query14801455

Writing & Preference GPT-5.6 Sol leads

GPT-5.6 Sol: 73.3 (#12), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkGPT-5.6 SolStep 5 Preview
LMArena Text14571442
LMArena Creative Writing14481410
LMArena Multi-Turn14601447
EQ-Bench Creative Writing1972—
EQ-Bench 41250—

Frequently asked questions

Is GPT-5.6 Sol better than Step 5 Preview?

GPT-5.6 Sol is the stronger model overall, scoring 65.0 to 47.9 on the Noometry Index. Step 5 Preview costs 5.6× less per token, which makes it the better buy when GPT-5.6 Sol's lead doesn't matter for your workload.

Which is cheaper, GPT-5.6 Sol or Step 5 Preview?

Step 5 Preview is cheaper. It lists at $1 per million input tokens and $2.70 per million output tokens; GPT-5.6 Sol lists at $4 and $20.

Is GPT-5.6 Sol or Step 5 Preview better for coding?

GPT-5.6 Sol scores higher on coding benchmarks: 65.1 versus 51.8 in the Noometry coding category.

Which has the bigger context window?

GPT-5.6 Sol does, with 1.05M tokens against 1.02M.

How many benchmarks do GPT-5.6 Sol and Step 5 Preview share?

18 benchmarks have published results for both models. GPT-5.6 Sol has 65 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper