Model comparison

Amazon Nova Experimental Chat 10 09 vs Chatgpt 4o Latest 20250326

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 41.9 on the Noometry Index.

Last verified . 9 shared benchmarks.

Summary

  • They share 9 benchmarks with published results for both. Amazon Nova Experimental Chat 10 09 scores higher in 0 categories and Chatgpt 4o Latest 20250326 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Chatgpt 4o Latest 20250326 leads 62.6 to 54.7.

Side by side

Amazon Nova Experimental Chat 10 09 and Chatgpt 4o Latest 20250326 specifications
Amazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
ProviderAmazonOpenAI
Noometry Index41.943.8
Released——
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked921

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 10 09: 40.2 (#145), Chatgpt 4o Latest 20250326: 41.6 (#122)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
LMArena Coding13701413

Reasoning Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 10 09: 27.3 (#120), Chatgpt 4o Latest 20250326: 33.8 (#71)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
LMArena Hard Prompts13561424
Kagi LLM Benchmark—75%

Math Not comparable

Amazon Nova Experimental Chat 10 09: —, Chatgpt 4o Latest 20250326: 38.6 (#134)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
LMArena Math—1407

Knowledge Not comparable

Amazon Nova Experimental Chat 10 09: —, Chatgpt 4o Latest 20250326: 39.2 (#137)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
Confabulations—16.6%
LMArena Expert—1401

Multimodal Not comparable

Amazon Nova Experimental Chat 10 09: —, Chatgpt 4o Latest 20250326: 39.6 (#58)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
LMArena Vision—1243

Multilingual Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 10 09: 47.3 (#150), Chatgpt 4o Latest 20250326: 52.9 (#76)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
LMArena Non-English13401419
LMArena Chinese13411457
LMArena French—1446
LMArena German—1423
LMArena Japanese—1405
LMArena Korean—1396
LMArena Russian—1429
LMArena Spanish—1434

Instruction Following Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 10 09: 69.4 (#172), Chatgpt 4o Latest 20250326: 74.0 (#107)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
LMArena Instruction Following13151403

Long Context Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 10 09: 40.5 (#152), Chatgpt 4o Latest 20250326: 43.1 (#107)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
LMArena Longer Query13331413

Writing & Preference Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 10 09: 54.7 (#149), Chatgpt 4o Latest 20250326: 62.6 (#72)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09Chatgpt 4o Latest 20250326
LMArena Text13641429
LMArena Creative Writing13071405
LMArena Multi-Turn13551454
EQ-Bench Creative Writing—1501

Frequently asked questions

Is Amazon Nova Experimental Chat 10 09 better than Chatgpt 4o Latest 20250326?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 41.9 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 09 or Chatgpt 4o Latest 20250326 better for coding?

Chatgpt 4o Latest 20250326 scores higher on coding benchmarks: 41.6 versus 40.2 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 09 and Chatgpt 4o Latest 20250326 share?

9 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 09 has 9 scored results on Noometry and Chatgpt 4o Latest 20250326 has 21.

Related comparisons

Go deeper