Model comparison

Chatgpt 4o Latest 20250326 vs Step 3

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 40.5 on the Noometry Index.

Last verified . 17 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.8

Rank #82 Confirmed

Step 3 StepFun

40.5

Rank #149 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Chatgpt 4o Latest 20250326 scores higher in 9 categories and Step 3 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Chatgpt 4o Latest 20250326 leads 62.6 to 54.3.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 75% for Chatgpt 4o Latest 20250326 and 62.3% for Step 3.
  • Step 3 has downloadable open weights; the other is API-only.

Side by side

Chatgpt 4o Latest 20250326 and Step 3 specifications
Chatgpt 4o Latest 20250326Step 3
ProviderOpenAIStepFun
Noometry Index43.840.5
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2117

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 41.6 (#122), Step 3: 40.1 (#147)

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Coding14131367

Reasoning Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 33.8 (#71), Step 3: 28.4 (#105)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
Kagi LLM Benchmark75%62.3%
LMArena Hard Prompts14241355

Math Too close to call

Chatgpt 4o Latest 20250326: 38.6 (#134), Step 3: 37.6 (#148)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Math14071366

Knowledge Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 39.2 (#137), Step 3: 36.8 (#164)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Expert14011333
Confabulations16.6%—

Multimodal Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 39.6 (#58), Step 3: 35.5 (#86)

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Vision12431177

Multilingual Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 52.9 (#76), Step 3: 46.3 (#159)

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Non-English14191327
LMArena Chinese14571397
LMArena German14231371
LMArena Korean13961269
LMArena Russian14291331
LMArena Spanish14341371
LMArena French1446—
LMArena Japanese1405—

Instruction Following Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 74.0 (#107), Step 3: 70.4 (#164)

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Instruction Following14031332

Long Context Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 43.1 (#107), Step 3: 40.3 (#157)

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Longer Query14131326

Writing & Preference Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 62.6 (#72), Step 3: 54.3 (#151)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326Step 3
LMArena Text14291350
LMArena Creative Writing14051321
LMArena Multi-Turn14541341
EQ-Bench Creative Writing1501—

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than Step 3?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 40.5 on the Noometry Index.

Is Chatgpt 4o Latest 20250326 or Step 3 better for coding?

Chatgpt 4o Latest 20250326 scores higher on coding benchmarks: 41.6 versus 40.1 in the Noometry coding category.

How many benchmarks do Chatgpt 4o Latest 20250326 and Step 3 share?

17 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and Step 3 has 17.

Related comparisons

Go deeper