Model comparison

Amazon Nova Experimental Chat 10 09 vs GPT-5 Nano

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 33.5 on the Noometry Index.

Last verified . 9 shared benchmarks.

GPT-5 Nano OpenAI

33.5

Rank #241 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Amazon Nova Experimental Chat 10 09 scores higher in 5 categories and GPT-5 Nano in 1 category; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 10 09 leads 54.7 to 39.1.

Side by side

Amazon Nova Experimental Chat 10 09 and GPT-5 Nano specifications
Amazon Nova Experimental Chat 10 09GPT-5 Nano
ProviderAmazonOpenAI
Noometry Index41.933.5
Released—2025-08-07
WeightsProprietaryProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.40
Results tracked949

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 40.2 (#145), GPT-5 Nano: 33.6 (#254)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
LMArena Coding13701351
SWE-bench Verified (bash only)—34.8%
WeirdML—38.1%
ALE-Bench—718.67

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 10 09: —, GPT-5 Nano: 25.8 (#106)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
Terminal-Bench—21.8%
Berkeley Function Calling Leaderboard—51.5%

Reasoning Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 27.3 (#120), GPT-5 Nano: 16.3 (#306)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
LMArena Hard Prompts13561328
ARC-AGI-2—2.6%
Kagi LLM Benchmark—62.2%
ARC-AGI-1—20.7%
Chess Puzzles—27%
Mystery Game Puzzles—9%
DTBench—62.7%
LMCA—7.9%
Epoch Capabilities Index—139.38
ForecastBench—59.1

Math Not comparable

Amazon Nova Experimental Chat 10 09: —, GPT-5 Nano: 29.4 (#241)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
FrontierMath (Tiers 1-3)—20%
FrontierMath Tier 4—2.4%
OTIS Mock AIME 2024-2025—81.1%
ProofBench—12%
Omni-MATH—54.6%
LMArena Math—1317
MATH Level 5—95.2%
FrontierMath (Feb 2025 set)—8.3%
FrontierMath Tier 4 (v1)—2.1%

Knowledge Not comparable

Amazon Nova Experimental Chat 10 09: —, GPT-5 Nano: 35.9 (#178)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
GPQA Diamond—69.4%
SimpleQA Verified—11.7%
MMLU-Pro—77.8%
Vectara Hallucination Rate—10.5%
GPQA (HELM)—67.9%
LMArena Expert—1321

Multimodal Not comparable

Amazon Nova Experimental Chat 10 09: —, GPT-5 Nano: 31.3 (#108)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
LMArena Vision—1159
VPCT—37.2%

Multilingual Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 47.3 (#150), GPT-5 Nano: 45.3 (#172)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
LMArena Non-English13401313
LMArena Chinese13411356
LMArena German—1327
LMArena Japanese—1226
LMArena Korean—1269
LMArena Russian—1296
LMArena Spanish—1360

Instruction Following GPT-5 Nano leads

Amazon Nova Experimental Chat 10 09: 69.4 (#172), GPT-5 Nano: 75.0 (#79)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
LMArena Instruction Following13151306
IFEval—93.2%

Long Context Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 40.5 (#152), GPT-5 Nano: 31.3 (#281)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
LMArena Longer Query13331312
Fiction.LiveBench—44.4%

Writing & Preference Amazon Nova Experimental Chat 10 09 leads

Amazon Nova Experimental Chat 10 09: 54.7 (#149), GPT-5 Nano: 39.1 (#249)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 09GPT-5 Nano
LMArena Text13641320
LMArena Creative Writing13071249
LMArena Multi-Turn13551311
EQ-Bench Creative Writing—705
WildBench—80.6%

Frequently asked questions

Is Amazon Nova Experimental Chat 10 09 better than GPT-5 Nano?

Amazon Nova Experimental Chat 10 09 is the stronger model overall, scoring 41.9 to 33.5 on the Noometry Index.

Is Amazon Nova Experimental Chat 10 09 or GPT-5 Nano better for coding?

Amazon Nova Experimental Chat 10 09 scores higher on coding benchmarks: 40.2 versus 33.6 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 09 and GPT-5 Nano share?

9 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 09 has 9 scored results on Noometry and GPT-5 Nano has 49.

Related comparisons

Go deeper