Model comparison

Amazon Nova Experimental Chat 11 10 vs Step 3

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 40.5 on the Noometry Index.

Last verified . 15 shared benchmarks.

Step 3 StepFun

40.5

Rank #149 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Amazon Nova Experimental Chat 11 10 scores higher in 8 categories and Step 3 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Amazon Nova Experimental Chat 11 10 leads 51.9 to 46.3.
  • Step 3 has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 11 10 and Step 3 specifications
Amazon Nova Experimental Chat 11 10Step 3
ProviderAmazonStepFun
Noometry Index43.040.5
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1717

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.3 (#107), Step 3: 40.1 (#147)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Step 3
LMArena Coding14331367

Reasoning Too close to call

Amazon Nova Experimental Chat 11 10: 29.1 (#95), Step 3: 28.4 (#105)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Step 3
LMArena Hard Prompts14221355
Kagi LLM Benchmark—62.3%

Math Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 39.1 (#114), Step 3: 37.6 (#148)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Step 3
LMArena Math14311366

Knowledge Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 39.9 (#127), Step 3: 36.8 (#164)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Step 3
LMArena Expert14311333

Multimodal Not comparable

Amazon Nova Experimental Chat 11 10: —, Step 3: 35.5 (#86)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Step 3
LMArena Vision—1177

Multilingual Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 51.9 (#98), Step 3: 46.3 (#159)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Step 3
LMArena Non-English14051327
LMArena Chinese14631397
LMArena German13951371
LMArena Korean13841269
LMArena Russian13941331
LMArena Spanish14441371
LMArena French1449—
LMArena Japanese1383—

Instruction Following Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 73.2 (#122), Step 3: 70.4 (#164)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Step 3
LMArena Instruction Following13871332

Long Context Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.5 (#121), Step 3: 40.3 (#157)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Step 3
LMArena Longer Query13951326

Writing & Preference Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 58.8 (#114), Step 3: 54.3 (#151)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Step 3
LMArena Text14151350
LMArena Creative Writing13491321
LMArena Multi-Turn13801341

Frequently asked questions

Is Amazon Nova Experimental Chat 11 10 better than Step 3?

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 40.5 on the Noometry Index.

Is Amazon Nova Experimental Chat 11 10 or Step 3 better for coding?

Amazon Nova Experimental Chat 11 10 scores higher on coding benchmarks: 42.3 versus 40.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 11 10 and Step 3 share?

15 benchmarks have published results for both models. Amazon Nova Experimental Chat 11 10 has 17 scored results on Noometry and Step 3 has 17.

Related comparisons

Go deeper