Model comparison

Amazon Nova Experimental Chat 10 20 vs GPT-5 Mini

Amazon Nova Experimental Chat 10 20 and GPT-5 Mini score almost the same on the Noometry Index (42.1 vs 41.8), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

GPT-5 Mini OpenAI

41.8

Rank #128 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 10 20 scores higher in 4 categories and GPT-5 Mini in 4 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5 Mini leads 46.7 to 39.0.

Side by side

Amazon Nova Experimental Chat 10 20 and GPT-5 Mini specifications
Amazon Nova Experimental Chat 10 20GPT-5 Mini
ProviderAmazonOpenAI
Noometry Index42.141.8
Released—2025-08-07
WeightsProprietaryProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$0.25
Output $ / M tokens—$2
Results tracked1760

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 41.6 (#123), GPT-5 Mini: 40.1 (#146)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
LMArena Coding14121406
SWE-bench Verified—64.7%
SWE-bench Verified (bash only)—59.8%
SWE-bench Multilingual—39.7%
SciCode—39.2%
WeirdML—52.7%
ALE-Bench—799.77
AlgoTune—1.38

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 10 20: —, GPT-5 Mini: 31.1 (#70)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
Terminal-Bench—34.8%
Berkeley Function Calling Leaderboard—55.5%
Vending-Bench 2—-31.18

Reasoning Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 28.4 (#106), GPT-5 Mini: 23.9 (#168)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
LMArena Hard Prompts13961380
ARC-AGI-2—4.4%
Kagi LLM Benchmark—70.3%
ARC-AGI-1—54.3%
CritPt—0%
Chess Puzzles—30%
EnigmaEval—8.2%
Mystery Game Puzzles—10%
DTBench—80.5%
LMCA—34.2%
Epoch Capabilities Index—145.52
ForecastBench—61

Math GPT-5 Mini leads

Amazon Nova Experimental Chat 10 20: 39.0 (#119), GPT-5 Mini: 46.7 (#69)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
LMArena Math14251378
FrontierMath (Tiers 1-3)—46.7%
FrontierMath Tier 4—12.2%
OTIS Mock AIME 2024-2025—86.7%
ProofBench—9%
Omni-MATH—72.2%
MATH Level 5—97.8%
FrontierMath (Feb 2025 set)—27.2%
FrontierMath Tier 4 (v1)—6.3%

Knowledge GPT-5 Mini leads

Amazon Nova Experimental Chat 10 20: 38.5 (#144), GPT-5 Mini: 45.6 (#86)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
LMArena Expert13861379
GPQA Diamond—75%
Humanity's Last Exam—19.4%
SimpleQA Verified—21.6%
MMLU-Pro—83.5%
Confabulations—13.3%
Vectara Hallucination Rate—12.9%
GPQA (HELM)—75.6%

Multimodal Not comparable

Amazon Nova Experimental Chat 10 20: —, GPT-5 Mini: 35.6 (#85)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
LMArena Vision—1202
VPCT—40.2%

Multilingual Too close to call

Amazon Nova Experimental Chat 10 20: 49.5 (#131), GPT-5 Mini: 48.9 (#137)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
LMArena Non-English13721363
LMArena Chinese14041385
LMArena French14251386
LMArena German13911366
LMArena Japanese13601341
LMArena Korean13241308
LMArena Russian13711362
LMArena Spanish13821355

Instruction Following GPT-5 Mini leads

Amazon Nova Experimental Chat 10 20: 72.1 (#141), GPT-5 Mini: 76.2 (#46)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
LMArena Instruction Following13651357
IFEval—92.7%

Long Context Too close to call

Amazon Nova Experimental Chat 10 20: 41.7 (#133), GPT-5 Mini: 41.9 (#132)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
LMArena Longer Query13701355
Fiction.LiveBench—69.4%

Writing & Preference Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 56.6 (#136), GPT-5 Mini: 55.2 (#148)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20GPT-5 Mini
LMArena Text13941373
LMArena Creative Writing13181325
LMArena Multi-Turn13641363
Short-Story Creative Writing—83.1%
EQ-Bench Creative Writing—1313
WildBench—85.5%

Frequently asked questions

Is Amazon Nova Experimental Chat 10 20 better than GPT-5 Mini?

Amazon Nova Experimental Chat 10 20 and GPT-5 Mini score almost the same on the Noometry Index (42.1 vs 41.8), so choose on price, context window or the category you care about most.

Is Amazon Nova Experimental Chat 10 20 or GPT-5 Mini better for coding?

Amazon Nova Experimental Chat 10 20 scores higher on coding benchmarks: 41.6 versus 40.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 20 and GPT-5 Mini share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 20 has 17 scored results on Noometry and GPT-5 Mini has 60.

Related comparisons

Go deeper