Model comparison

o3-pro vs Step 3.5 Flash

o3-pro and Step 3.5 Flash score almost the same on the Noometry Index (42.9 vs 42.3), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

o3-pro OpenAI

42.9

Rank #105 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • The widest gap is in long context, where o3-pro leads 72.2 to 42.8.
  • Step 3.5 Flash is cheaper at $0.10 / $0.30 per million input/output tokens, against $20 / $80 for o3-pro.
  • Step 3.5 Flash accepts more context: 256K tokens versus 200K.
  • Step 3.5 Flash has downloadable open weights; the other is API-only.

Side by side

o3-pro and Step 3.5 Flash specifications
o3-proStep 3.5 Flash
ProviderOpenAIStepFun
Noometry Index42.942.3
Released2025-06-102026-01-29
WeightsProprietaryOpen
Context window200K256K
Max output100K256K
Input $ / M tokens$20$0.10
Output $ / M tokens$80$0.30
Results tracked1219

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3-pro leads

o3-pro: 55.5 (#24), Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
Benchmarko3-proStep 3.5 Flash
Aider Polyglot84.9%—
WeirdML58.2%—
LMArena Coding—1436

Reasoning o3-pro leads

o3-pro: 23.8 (#171), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
Benchmarko3-proStep 3.5 Flash
ARC-AGI-24.9%—
Kagi LLM Benchmark72.1%—
NYT Connections (extended)—28.4%
ARC-AGI-159.3%—
LMArena Hard Prompts—1411
DTBench86.9%—
LMCA38.5%—
Epoch Capabilities Index147.42—

Math Not comparable

o3-pro: —, Step 3.5 Flash: 42.6 (#84)

Math benchmarks
Benchmarko3-proStep 3.5 Flash
MathArena Final-Answer Competitions—66.8%
LMArena Math—1408

Knowledge Step 3.5 Flash leads

o3-pro: 29.5 (#238), Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
Benchmarko3-proStep 3.5 Flash
Confabulations14.2%—
Vectara Hallucination Rate23.3%—
LMArena Expert—1421

Multilingual Not comparable

o3-pro: —, Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
Benchmarko3-proStep 3.5 Flash
LMArena Non-English—1385
LMArena Chinese—1447
LMArena French—1421
LMArena German—1405
LMArena Japanese—1354
LMArena Korean—1352
LMArena Russian—1385
LMArena Spanish—1419

Instruction Following Not comparable

o3-pro: —, Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
Benchmarko3-proStep 3.5 Flash
LMArena Instruction Following—1385

Long Context o3-pro leads

o3-pro: 72.2 (#1), Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
Benchmarko3-proStep 3.5 Flash
Fiction.LiveBench97.2%—
LMArena Longer Query—1402

Writing & Preference Step 3.5 Flash leads

o3-pro: 57.1 (#133), Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
Benchmarko3-proStep 3.5 Flash
LMArena Text—1403
LMArena Creative Writing—1357
Short-Story Creative Writing84.4%—
LMArena Multi-Turn—1405

Frequently asked questions

Is o3-pro better than Step 3.5 Flash?

o3-pro and Step 3.5 Flash score almost the same on the Noometry Index (42.9 vs 42.3), so choose on price, context window or the category you care about most.

Which is cheaper, o3-pro or Step 3.5 Flash?

Step 3.5 Flash is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; o3-pro lists at $20 and $80.

Is o3-pro or Step 3.5 Flash better for coding?

o3-pro scores higher on coding benchmarks: 55.5 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

Step 3.5 Flash does, with 256K tokens against 200K.

How many benchmarks do o3-pro and Step 3.5 Flash share?

0 benchmarks have published results for both models. o3-pro has 12 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper