Model comparison

GPT-5.1-Codex vs Step 5 Preview

Step 5 Preview is the stronger model overall, scoring 47.9 to 38.6 on the Noometry Index.

Last verified . 2 shared benchmarks.

GPT-5.1-Codex OpenAI

38.6

Rank #186 Reported

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 2 benchmarks with published results for both. GPT-5.1-Codex scores higher in 0 categories and Step 5 Preview in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in math, where Step 5 Preview leads 46.1 to 30.3.
  • The biggest single-benchmark swing is ProofBench: 9% for GPT-5.1-Codex and 42% for Step 5 Preview.
  • Step 5 Preview is cheaper at $1 / $2.70 per million input/output tokens, against $1.25 / $10 for GPT-5.1-Codex.
  • Step 5 Preview accepts more context: 1.02M tokens versus 400K.

Side by side

GPT-5.1-Codex and Step 5 Preview specifications
GPT-5.1-CodexStep 5 Preview
ProviderOpenAIStepFun
Noometry Index38.647.9
Released2025-11-122026-09-16
WeightsProprietaryProprietary
Context window400K1.02M
Max output128K66K
Input $ / M tokens$1.25$1
Output $ / M tokens$10$2.70
Results tracked618

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

GPT-5.1-Codex: 41.9 (#116), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
LMArena WebDev13371564
SWE-bench Verified (bash only)66%—
SciCode—58.9%
LMArena Coding—1480
ALE-Bench1,245—

Agentic & Tool Use Not comparable

GPT-5.1-Codex: 38.0 (#33), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
Terminal-Bench60.4%—
METR Time Horizons70.8%—

Reasoning Not comparable

GPT-5.1-Codex: —, Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
CritPt—20.9%
LMArena Hard Prompts—1465

Math Step 5 Preview leads

GPT-5.1-Codex: 30.3 (#235), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
ProofBench9%42%
LMArena Math—1470

Knowledge Not comparable

GPT-5.1-Codex: —, Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
LMArena Expert—1470

Multimodal Not comparable

GPT-5.1-Codex: —, Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
LMArena Vision—1267

Multilingual Not comparable

GPT-5.1-Codex: —, Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
LMArena Non-English—1432
LMArena Chinese—1519
LMArena Russian—1436
LMArena Spanish—1439

Instruction Following Not comparable

GPT-5.1-Codex: —, Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
LMArena Instruction Following—1444

Long Context Not comparable

GPT-5.1-Codex: —, Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
LMArena Longer Query—1455

Writing & Preference Not comparable

GPT-5.1-Codex: —, Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkGPT-5.1-CodexStep 5 Preview
LMArena Text—1442
LMArena Creative Writing—1410
LMArena Multi-Turn—1447

Frequently asked questions

Is GPT-5.1-Codex better than Step 5 Preview?

Step 5 Preview is the stronger model overall, scoring 47.9 to 38.6 on the Noometry Index.

Which is cheaper, GPT-5.1-Codex or Step 5 Preview?

Step 5 Preview is cheaper. It lists at $1 per million input tokens and $2.70 per million output tokens; GPT-5.1-Codex lists at $1.25 and $10.

Is GPT-5.1-Codex or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 51.8 versus 41.9 in the Noometry coding category.

Which has the bigger context window?

Step 5 Preview does, with 1.02M tokens against 400K.

How many benchmarks do GPT-5.1-Codex and Step 5 Preview share?

2 benchmarks have published results for both models. GPT-5.1-Codex has 6 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper