Model comparison

Amazon Nova Experimental Chat 26 01 10 vs Step 3

Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 40.5 on the Noometry Index.

Last verified . 13 shared benchmarks.

Step 3 StepFun

40.5

Rank #149 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Amazon Nova Experimental Chat 26 01 10 scores higher in 8 categories and Step 3 in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Amazon Nova Experimental Chat 26 01 10 leads 50.2 to 46.3.
  • Step 3 has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 26 01 10 and Step 3 specifications
Amazon Nova Experimental Chat 26 01 10Step 3
ProviderAmazonStepFun
Noometry Index42.840.5
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1317

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 42.7 (#96), Step 3: 40.1 (#147)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Step 3
LMArena Coding14471367

Reasoning Too close to call

Amazon Nova Experimental Chat 26 01 10: 28.9 (#98), Step 3: 28.4 (#105)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Step 3
LMArena Hard Prompts14151355
Kagi LLM Benchmark—62.3%

Math Too close to call

Amazon Nova Experimental Chat 26 01 10: 38.5 (#136), Step 3: 37.6 (#148)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Step 3
LMArena Math14041366

Knowledge Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 40.3 (#120), Step 3: 36.8 (#164)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Step 3
LMArena Expert14441333

Multimodal Not comparable

Amazon Nova Experimental Chat 26 01 10: —, Step 3: 35.5 (#86)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Step 3
LMArena Vision—1177

Multilingual Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 50.2 (#126), Step 3: 46.3 (#159)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Step 3
LMArena Non-English13811327
LMArena Chinese13721397
LMArena Russian13911331
LMArena Spanish13901371
LMArena German—1371
LMArena Korean—1269

Instruction Following Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 72.9 (#126), Step 3: 70.4 (#164)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Step 3
LMArena Instruction Following13811332

Long Context Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 42.7 (#119), Step 3: 40.3 (#157)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Step 3
LMArena Longer Query14001326

Writing & Preference Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 57.4 (#129), Step 3: 54.3 (#151)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Step 3
LMArena Text13961350
LMArena Creative Writing13311321
LMArena Multi-Turn13801341

Frequently asked questions

Is Amazon Nova Experimental Chat 26 01 10 better than Step 3?

Amazon Nova Experimental Chat 26 01 10 is the stronger model overall, scoring 42.8 to 40.5 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 01 10 or Step 3 better for coding?

Amazon Nova Experimental Chat 26 01 10 scores higher on coding benchmarks: 42.7 versus 40.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 01 10 and Step 3 share?

13 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 01 10 has 13 scored results on Noometry and Step 3 has 17.

Related comparisons

Go deeper