Model comparison

Amazon Nova Experimental Chat 11 10 vs Chatgpt 4o Latest 20250326

Amazon Nova Experimental Chat 11 10 and Chatgpt 4o Latest 20250326 score almost the same on the Noometry Index (42.4 vs 43.2), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 11 10 scores higher in 3 categories and Chatgpt 4o Latest 20250326 in 5 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Chatgpt 4o Latest 20250326 leads 32.8 to 27.9.

Side by side

Amazon Nova Experimental Chat 11 10 and Chatgpt 4o Latest 20250326 specifications
Amazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
ProviderAmazonOpenAI
Noometry Index42.443.2
Released——
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1721

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Experimental Chat 11 10: 41.6 (#109), Chatgpt 4o Latest 20250326: 41.0 (#122)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
LMArena Coding14331413

Reasoning Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 11 10: 27.9 (#94), Chatgpt 4o Latest 20250326: 32.8 (#64)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
LMArena Hard Prompts14221424
Kagi LLM Benchmark—75%

Math Too close to call

Amazon Nova Experimental Chat 11 10: 36.4 (#116), Chatgpt 4o Latest 20250326: 35.8 (#134)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
LMArena Math14311407

Knowledge Too close to call

Amazon Nova Experimental Chat 11 10: 39.3 (#122), Chatgpt 4o Latest 20250326: 38.7 (#131)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
LMArena Expert14321400
Confabulations—16.6%

Multimodal Not comparable

Amazon Nova Experimental Chat 11 10: —, Chatgpt 4o Latest 20250326: 38.9 (#54)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
LMArena Vision—1243

Multilingual Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 11 10: 52.1 (#91), Chatgpt 4o Latest 20250326: 53.1 (#72)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
LMArena Non-English14051419
LMArena Chinese14631456
LMArena French14491447
LMArena German13961424
LMArena Japanese13831406
LMArena Korean13871397
LMArena Russian13951429
LMArena Spanish14441435

Instruction Following Too close to call

Amazon Nova Experimental Chat 11 10: 73.4 (#118), Chatgpt 4o Latest 20250326: 74.2 (#102)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
LMArena Instruction Following13871403

Long Context Too close to call

Amazon Nova Experimental Chat 11 10: 42.5 (#116), Chatgpt 4o Latest 20250326: 43.1 (#104)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
LMArena Longer Query13951413

Writing & Preference Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 11 10: 59.0 (#109), Chatgpt 4o Latest 20250326: 62.8 (#68)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Chatgpt 4o Latest 20250326
LMArena Text14151429
LMArena Creative Writing13491406
LMArena Multi-Turn13801454
EQ-Bench Creative Writing—1501

Frequently asked questions

Is Amazon Nova Experimental Chat 11 10 better than Chatgpt 4o Latest 20250326?

Amazon Nova Experimental Chat 11 10 and Chatgpt 4o Latest 20250326 score almost the same on the Noometry Index (42.4 vs 43.2), so choose on price, context window or the category you care about most.

Is Amazon Nova Experimental Chat 11 10 or Chatgpt 4o Latest 20250326 better for coding?

They score almost the same on coding (41.6 vs 41.0); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Experimental Chat 11 10 and Chatgpt 4o Latest 20250326 share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 11 10 has 17 scored results on Noometry and Chatgpt 4o Latest 20250326 has 21.

Related comparisons

Go deeper