Model comparison

Amazon Nova Experimental Chat 10 20 vs Step 3

Amazon Nova Experimental Chat 10 20 is the stronger model overall, scoring 42.1 to 40.5 on the Noometry Index.

Last verified . 15 shared benchmarks.

Step 3 StepFun

40.5

Rank #149 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Amazon Nova Experimental Chat 10 20 scores higher in 7 categories and Step 3 in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Amazon Nova Experimental Chat 10 20 leads 49.5 to 46.3.
  • Step 3 has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 10 20 and Step 3 specifications
Amazon Nova Experimental Chat 10 20Step 3
ProviderAmazonStepFun
Noometry Index42.140.5
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1717

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 41.6 (#123), Step 3: 40.1 (#147)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3
LMArena Coding14121367

Reasoning Too close to call

Amazon Nova Experimental Chat 10 20: 28.4 (#106), Step 3: 28.4 (#105)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3
LMArena Hard Prompts13961355
Kagi LLM Benchmark—62.3%

Math Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 39.0 (#119), Step 3: 37.6 (#148)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3
LMArena Math14251366

Knowledge Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 38.5 (#144), Step 3: 36.8 (#164)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3
LMArena Expert13861333

Multimodal Not comparable

Amazon Nova Experimental Chat 10 20: —, Step 3: 35.5 (#86)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3
LMArena Vision—1177

Multilingual Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 49.5 (#131), Step 3: 46.3 (#159)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3
LMArena Non-English13721327
LMArena Chinese14041397
LMArena German13911371
LMArena Korean13241269
LMArena Russian13711331
LMArena Spanish13821371
LMArena French1425—
LMArena Japanese1360—

Instruction Following Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 72.1 (#141), Step 3: 70.4 (#164)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3
LMArena Instruction Following13651332

Long Context Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 41.7 (#133), Step 3: 40.3 (#157)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3
LMArena Longer Query13701326

Writing & Preference Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 56.6 (#136), Step 3: 54.3 (#151)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Step 3
LMArena Text13941350
LMArena Creative Writing13181321
LMArena Multi-Turn13641341

Frequently asked questions

Is Amazon Nova Experimental Chat 10 20 better than Step 3?

Amazon Nova Experimental Chat 10 20 is the stronger model overall, scoring 42.1 to 40.5 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 20 or Step 3 better for coding?

Amazon Nova Experimental Chat 10 20 scores higher on coding benchmarks: 41.6 versus 40.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 20 and Step 3 share?

15 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 20 has 17 scored results on Noometry and Step 3 has 17.

Related comparisons

Go deeper