Model comparison
Amazon Nova Experimental Chat 12 10 vs Chatgpt 4o Latest 20250326
Amazon Nova Experimental Chat 12 10 and Chatgpt 4o Latest 20250326 score almost the same on the Noometry Index (42.3 vs 43.2), so choose on price, context window or the category you care about most.
Last verified . 12 shared benchmarks.
Summary
- They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 12 10 scores higher in 2 categories and Chatgpt 4o Latest 20250326 in 6 categories; 3 gaps are clear of the uncertainty.
- The widest gap is in reasoning, where Chatgpt 4o Latest 20250326 leads 32.8 to 28.1.
Side by side
| Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 | |
|---|---|---|
| Provider | Amazon | OpenAI |
| Noometry Index | 42.3 | 43.2 |
| Released | — | — |
| Weights | Proprietary | Proprietary |
| Context window | — | — |
| Max output | — | — |
| Input $ / M tokens | — | — |
| Output $ / M tokens | — | — |
| Results tracked | 12 | 21 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Too close to call
Amazon Nova Experimental Chat 12 10: 41.5 (#112), Chatgpt 4o Latest 20250326: 41.0 (#122)
| Benchmark | Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 |
|---|---|---|
| LMArena Coding | 1430 | 1413 |
Reasoning Chatgpt 4o Latest 20250326 leads
Amazon Nova Experimental Chat 12 10: 28.1 (#93), Chatgpt 4o Latest 20250326: 32.8 (#64)
| Benchmark | Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 |
|---|---|---|
| LMArena Hard Prompts | 1427 | 1424 |
| Kagi LLM Benchmark | — | 75% |
Math Too close to call
Amazon Nova Experimental Chat 12 10: 36.1 (#130), Chatgpt 4o Latest 20250326: 35.8 (#134)
| Benchmark | Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 |
|---|---|---|
| LMArena Math | 1418 | 1407 |
Knowledge Too close to call
Amazon Nova Experimental Chat 12 10: 38.6 (#133), Chatgpt 4o Latest 20250326: 38.7 (#131)
| Benchmark | Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 |
|---|---|---|
| LMArena Expert | 1409 | 1400 |
| Confabulations | — | 16.6% |
Multimodal Not comparable
Amazon Nova Experimental Chat 12 10: —, Chatgpt 4o Latest 20250326: 38.9 (#54)
| Benchmark | Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 |
|---|---|---|
| LMArena Vision | — | 1243 |
Multilingual Chatgpt 4o Latest 20250326 leads
Amazon Nova Experimental Chat 12 10: 51.7 (#103), Chatgpt 4o Latest 20250326: 53.1 (#72)
| Benchmark | Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 |
|---|---|---|
| LMArena Non-English | 1399 | 1419 |
| LMArena Chinese | 1440 | 1456 |
| LMArena Russian | 1397 | 1429 |
| LMArena French | — | 1447 |
| LMArena German | — | 1424 |
| LMArena Japanese | — | 1406 |
| LMArena Korean | — | 1397 |
| LMArena Spanish | — | 1435 |
Instruction Following Too close to call
Amazon Nova Experimental Chat 12 10: 73.4 (#117), Chatgpt 4o Latest 20250326: 74.2 (#102)
| Benchmark | Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 |
|---|---|---|
| LMArena Instruction Following | 1387 | 1403 |
Long Context Too close to call
Amazon Nova Experimental Chat 12 10: 42.4 (#120), Chatgpt 4o Latest 20250326: 43.1 (#104)
| Benchmark | Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 |
|---|---|---|
| LMArena Longer Query | 1391 | 1413 |
Writing & Preference Chatgpt 4o Latest 20250326 leads
Amazon Nova Experimental Chat 12 10: 59.7 (#104), Chatgpt 4o Latest 20250326: 62.8 (#68)
| Benchmark | Amazon Nova Experimental Chat 12 10 | Chatgpt 4o Latest 20250326 |
|---|---|---|
| LMArena Text | 1420 | 1429 |
| LMArena Creative Writing | 1351 | 1406 |
| LMArena Multi-Turn | 1409 | 1454 |
| EQ-Bench Creative Writing | — | 1501 |
Frequently asked questions
Is Amazon Nova Experimental Chat 12 10 better than Chatgpt 4o Latest 20250326?
Amazon Nova Experimental Chat 12 10 and Chatgpt 4o Latest 20250326 score almost the same on the Noometry Index (42.3 vs 43.2), so choose on price, context window or the category you care about most.
Is Amazon Nova Experimental Chat 12 10 or Chatgpt 4o Latest 20250326 better for coding?
They score almost the same on coding (41.5 vs 41.0); test both on your own repository before choosing.
How many benchmarks do Amazon Nova Experimental Chat 12 10 and Chatgpt 4o Latest 20250326 share?
12 benchmarks have published results for both models. Amazon Nova Experimental Chat 12 10 has 12 scored results on Noometry and Chatgpt 4o Latest 20250326 has 21.