Model comparison

Amazon Nova Experimental Chat 10 09 vs Step 3

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 40.5 on the Noometry Index.

Last verified . 9 shared benchmarks.

Step 3 StepFun

40.5

Rank #149 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Amazon Nova Experimental Chat 10 09 scores higher in 4 categories and Step 3 in 2 categories; one gap is clear of the uncertainty.
  • Step 3 has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 10 09 and Step 3 specifications
Amazon Nova Experimental Chat 10 09Step 3
ProviderAmazonStepFun
Noometry Index41.940.5
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked917

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Experimental Chat 10 09: 40.2 (#145), Step 3: 40.1 (#147)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Step 3
LMArena Coding13701367

Reasoning Step 3 leads

Amazon Nova Experimental Chat 10 09: 27.3 (#120), Step 3: 28.4 (#105)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Step 3
LMArena Hard Prompts13561355
Kagi LLM Benchmark—62.3%

Math Not comparable

Amazon Nova Experimental Chat 10 09: —, Step 3: 37.6 (#148)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Step 3
LMArena Math—1366

Knowledge Not comparable

Amazon Nova Experimental Chat 10 09: —, Step 3: 36.8 (#164)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Step 3
LMArena Expert—1333

Multimodal Not comparable

Amazon Nova Experimental Chat 10 09: —, Step 3: 35.5 (#86)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Step 3
LMArena Vision—1177

Multilingual Too close to call

Amazon Nova Experimental Chat 10 09: 47.3 (#150), Step 3: 46.3 (#159)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Step 3
LMArena Non-English13401327
LMArena Chinese13411397
LMArena German—1371
LMArena Korean—1269
LMArena Russian—1331
LMArena Spanish—1371

Instruction Following Too close to call

Amazon Nova Experimental Chat 10 09: 69.4 (#172), Step 3: 70.4 (#164)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Step 3
LMArena Instruction Following13151332

Long Context Too close to call

Amazon Nova Experimental Chat 10 09: 40.5 (#152), Step 3: 40.3 (#157)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Step 3
LMArena Longer Query13331326

Writing & Preference Too close to call

Amazon Nova Experimental Chat 10 09: 54.7 (#149), Step 3: 54.3 (#151)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Step 3
LMArena Text13641350
LMArena Creative Writing13071321
LMArena Multi-Turn13551341

Frequently asked questions

Is Amazon Nova Experimental Chat 10 09 better than Step 3?

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 40.5 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 09 or Step 3 better for coding?

They score almost the same on coding (40.2 vs 40.1); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Experimental Chat 10 09 and Step 3 share?

9 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 09 has 9 scored results on Noometry and Step 3 has 17.

Related comparisons

Go deeper