Model comparison

GPT-6 Astra vs Step 5 Preview

GPT-6 Astra is the stronger model overall, scoring 70.8 to 47.9 on the Noometry Index. Step 5 Preview costs 14× less per token, which makes it the better buy when GPT-6 Astra's lead doesn't matter for your workload.

Last verified . 18 shared benchmarks.

GPT-6 Astra OpenAI

70.8

Rank #1 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 18 benchmarks with published results for both. GPT-6 Astra scores higher in 8 categories and Step 5 Preview in 1 category; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-6 Astra leads 93.5 to 46.1.
  • The biggest single-benchmark swing is ProofBench: 99% for GPT-6 Astra and 42% for Step 5 Preview.
  • Step 5 Preview is cheaper at $1 / $2.70 per million input/output tokens, against $10 / $50 for GPT-6 Astra.
  • GPT-6 Astra accepts more context: 1.05M tokens versus 1.02M.

Side by side

GPT-6 Astra and Step 5 Preview specifications
GPT-6 AstraStep 5 Preview
ProviderOpenAIStepFun
Noometry Index70.847.9
Released2026-09-032026-09-16
WeightsProprietaryProprietary
Context window1.05M1.02M
Max output128K66K
Input $ / M tokens$10$1
Output $ / M tokens$50$2.70
Results tracked5618

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6 Astra leads

GPT-6 Astra: 73.7 (#2), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
LMArena WebDev17861564
SciCode56.5%58.9%
LMArena Coding14871480
DeepSWE74.1%—
FrontierCode53.3%—
FrontierSWE65.5%—
GSO79.4%—
WeirdML93.6%—
MirrorCode46.7%—
ALE-Bench2,951—

Agentic & Tool Use Not comparable

GPT-6 Astra: 52.9 (#3), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
APEX-Agents64.7%—
Remote Labor Index20.8%—
BALROG68.3%—
GDP.pdf34.2%—
Vending-Bench 215,515—

Reasoning GPT-6 Astra leads

GPT-6 Astra: 85.1 (#1), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
CritPt31.7%20.9%
LMArena Hard Prompts14621465
ARC-AGI-295%—
NYT Connections (extended)98.1%—
ARC-AGI-198.5%—
Chess Puzzles72%—
EBR-Bench76.2%—
Mystery Game Puzzles84%—
DTBench97.3%—
LMCA64.4%—
Bench to the Future 30.14—
Epoch Capabilities Index166.45—

Math GPT-6 Astra leads

GPT-6 Astra: 93.5 (#2), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
ProofBench99%42%
LMArena Math14651470
FrontierMath (Tiers 1-3)93.7%—
FrontierMath Tier 497.6%—
OTIS Mock AIME 2024-2025100%—
FrontierMath Erdős2.9%—

Knowledge GPT-6 Astra leads

GPT-6 Astra: 75.3 (#1), Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
LMArena Expert14831470
GPQA Diamond95.8%—
Humanity's Last Exam54.8%—
SimpleQA Verified75.6%—
Vectara Hallucination Rate8.7%—

Multimodal GPT-6 Astra leads

GPT-6 Astra: 55.0 (#3), Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
LMArena Vision12811267
Blueprint-Bench 249.7%—
Furniture Assembly80%—
LMArena Document1468—

Multilingual Too close to call

GPT-6 Astra: 53.7 (#61), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
LMArena Non-English14301432
LMArena Chinese14841519
LMArena Russian14361436
LMArena Spanish14071439
LMArena French1456—
LMArena German1440—
LMArena Japanese1379—
LMArena Korean1426—

Instruction Following Too close to call

GPT-6 Astra: 76.3 (#44), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
LMArena Instruction Following14501444

Long Context Too close to call

GPT-6 Astra: 44.5 (#62), Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
LMArena Longer Query14561455

Writing & Preference GPT-6 Astra leads

GPT-6 Astra: 75.3 (#7), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkGPT-6 AstraStep 5 Preview
LMArena Text14411442
LMArena Creative Writing14181410
LMArena Multi-Turn14481447
EQ-Bench Creative Writing2173—

Frequently asked questions

Is GPT-6 Astra better than Step 5 Preview?

GPT-6 Astra is the stronger model overall, scoring 70.8 to 47.9 on the Noometry Index. Step 5 Preview costs 14× less per token, which makes it the better buy when GPT-6 Astra's lead doesn't matter for your workload.

Which is cheaper, GPT-6 Astra or Step 5 Preview?

Step 5 Preview is cheaper. It lists at $1 per million input tokens and $2.70 per million output tokens; GPT-6 Astra lists at $10 and $50.

Is GPT-6 Astra or Step 5 Preview better for coding?

GPT-6 Astra scores higher on coding benchmarks: 73.7 versus 51.8 in the Noometry coding category.

Which has the bigger context window?

GPT-6 Astra does, with 1.05M tokens against 1.02M.

How many benchmarks do GPT-6 Astra and Step 5 Preview share?

18 benchmarks have published results for both models. GPT-6 Astra has 56 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper