Model comparison

Amazon Nova Experimental Chat 26 01 10 vs Chatgpt 4o Latest 20250326

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 42.2 on the Noometry Index.

Last verified . 13 shared benchmarks.

Summary

  • They share 13 benchmarks with published results for both. Amazon Nova Experimental Chat 26 01 10 scores higher in 2 categories and Chatgpt 4o Latest 20250326 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Chatgpt 4o Latest 20250326 leads 62.8 to 57.6.

Side by side

Amazon Nova Experimental Chat 26 01 10 and Chatgpt 4o Latest 20250326 specifications
Amazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
ProviderAmazonOpenAI
Noometry Index42.243.2
Released——
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1321

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 42.1 (#97), Chatgpt 4o Latest 20250326: 41.0 (#122)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
LMArena Coding14471413

Reasoning Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 26 01 10: 27.8 (#97), Chatgpt 4o Latest 20250326: 32.8 (#64)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
LMArena Hard Prompts14151424
Kagi LLM Benchmark—75%

Math Too close to call

Amazon Nova Experimental Chat 26 01 10: 35.8 (#136), Chatgpt 4o Latest 20250326: 35.8 (#134)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
LMArena Math14041407

Knowledge Amazon Nova Experimental Chat 26 01 10 leads

Amazon Nova Experimental Chat 26 01 10: 39.7 (#115), Chatgpt 4o Latest 20250326: 38.7 (#131)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
LMArena Expert14451400
Confabulations—16.6%

Multimodal Not comparable

Amazon Nova Experimental Chat 26 01 10: —, Chatgpt 4o Latest 20250326: 38.9 (#54)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
LMArena Vision—1243

Multilingual Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 26 01 10: 50.4 (#121), Chatgpt 4o Latest 20250326: 53.1 (#72)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
LMArena Non-English13811419
LMArena Chinese13731456
LMArena Russian13931429
LMArena Spanish13901435
LMArena French—1447
LMArena German—1424
LMArena Japanese—1406
LMArena Korean—1397

Instruction Following Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 26 01 10: 73.1 (#121), Chatgpt 4o Latest 20250326: 74.2 (#102)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
LMArena Instruction Following13811403

Long Context Too close to call

Amazon Nova Experimental Chat 26 01 10: 42.7 (#114), Chatgpt 4o Latest 20250326: 43.1 (#104)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
LMArena Longer Query14011413

Writing & Preference Chatgpt 4o Latest 20250326 leads

Amazon Nova Experimental Chat 26 01 10: 57.6 (#123), Chatgpt 4o Latest 20250326: 62.8 (#68)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10Chatgpt 4o Latest 20250326
LMArena Text13961429
LMArena Creative Writing13311406
LMArena Multi-Turn13801454
EQ-Bench Creative Writing—1501

Frequently asked questions

Is Amazon Nova Experimental Chat 26 01 10 better than Chatgpt 4o Latest 20250326?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 42.2 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 01 10 or Chatgpt 4o Latest 20250326 better for coding?

Amazon Nova Experimental Chat 26 01 10 scores higher on coding benchmarks: 42.1 versus 41.0 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 01 10 and Chatgpt 4o Latest 20250326 share?

13 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 01 10 has 13 scored results on Noometry and Chatgpt 4o Latest 20250326 has 21.

Related comparisons

Go deeper