Model comparison

Amazon Nova Experimental Chat 11 10 vs GPT-5 Mini

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 41.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-5 Mini OpenAI

41.8

Rank #128 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 11 10 scores higher in 5 categories and GPT-5 Mini in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5 Mini leads 46.7 to 39.1.

Side by side

Amazon Nova Experimental Chat 11 10 and GPT-5 Mini specifications
Amazon Nova Experimental Chat 11 10GPT-5 Mini
ProviderAmazonOpenAI
Noometry Index43.041.8
Released—2025-08-07
WeightsProprietaryProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$0.25
Output $ / M tokens—$2
Results tracked1760

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.3 (#107), GPT-5 Mini: 40.1 (#146)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
LMArena Coding14331406
SWE-bench Verified—64.7%
SWE-bench Verified (bash only)—59.8%
SWE-bench Multilingual—39.7%
SciCode—39.2%
WeirdML—52.7%
ALE-Bench—799.77
AlgoTune—1.38

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 11 10: —, GPT-5 Mini: 31.1 (#70)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
Terminal-Bench—34.8%
Berkeley Function Calling Leaderboard—55.5%
Vending-Bench 2—-31.18

Reasoning Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 29.1 (#95), GPT-5 Mini: 23.9 (#168)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
LMArena Hard Prompts14221380
ARC-AGI-2—4.4%
Kagi LLM Benchmark—70.3%
ARC-AGI-1—54.3%
CritPt—0%
Chess Puzzles—30%
EnigmaEval—8.2%
Mystery Game Puzzles—10%
DTBench—80.5%
LMCA—34.2%
Epoch Capabilities Index—145.52
ForecastBench—61

Math GPT-5 Mini leads

Amazon Nova Experimental Chat 11 10: 39.1 (#114), GPT-5 Mini: 46.7 (#69)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
LMArena Math14311378
FrontierMath (Tiers 1-3)—46.7%
FrontierMath Tier 4—12.2%
OTIS Mock AIME 2024-2025—86.7%
ProofBench—9%
Omni-MATH—72.2%
MATH Level 5—97.8%
FrontierMath (Feb 2025 set)—27.2%
FrontierMath Tier 4 (v1)—6.3%

Knowledge GPT-5 Mini leads

Amazon Nova Experimental Chat 11 10: 39.9 (#127), GPT-5 Mini: 45.6 (#86)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
LMArena Expert14311379
GPQA Diamond—75%
Humanity's Last Exam—19.4%
SimpleQA Verified—21.6%
MMLU-Pro—83.5%
Confabulations—13.3%
Vectara Hallucination Rate—12.9%
GPQA (HELM)—75.6%

Multimodal Not comparable

Amazon Nova Experimental Chat 11 10: —, GPT-5 Mini: 35.6 (#85)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
LMArena Vision—1202
VPCT—40.2%

Multilingual Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 51.9 (#98), GPT-5 Mini: 48.9 (#137)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
LMArena Non-English14051363
LMArena Chinese14631385
LMArena French14491386
LMArena German13951366
LMArena Japanese13831341
LMArena Korean13841308
LMArena Russian13941362
LMArena Spanish14441355

Instruction Following GPT-5 Mini leads

Amazon Nova Experimental Chat 11 10: 73.2 (#122), GPT-5 Mini: 76.2 (#46)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
LMArena Instruction Following13871357
IFEval—92.7%

Long Context Too close to call

Amazon Nova Experimental Chat 11 10: 42.5 (#121), GPT-5 Mini: 41.9 (#132)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
LMArena Longer Query13951355
Fiction.LiveBench—69.4%

Writing & Preference Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 58.8 (#114), GPT-5 Mini: 55.2 (#148)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10GPT-5 Mini
LMArena Text14151373
LMArena Creative Writing13491325
LMArena Multi-Turn13801363
Short-Story Creative Writing—83.1%
EQ-Bench Creative Writing—1313
WildBench—85.5%

Frequently asked questions

Is Amazon Nova Experimental Chat 11 10 better than GPT-5 Mini?

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 41.8 on the Noometry Index.

Is Amazon Nova Experimental Chat 11 10 or GPT-5 Mini better for coding?

Amazon Nova Experimental Chat 11 10 scores higher on coding benchmarks: 42.3 versus 40.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 11 10 and GPT-5 Mini share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 11 10 has 17 scored results on Noometry and GPT-5 Mini has 60.

Related comparisons

Go deeper