Model comparison

Amazon Nova Experimental Chat 11 10 vs Claude Sonnet 4.5

Claude Sonnet 4.5 is the stronger model overall, scoring 44.1 to 43.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

Claude Sonnet 4.5 Anthropic

44.1

Rank #81 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 11 10 scores higher in 2 categories and Claude Sonnet 4.5 in 6 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude Sonnet 4.5 leads 48.4 to 39.9.

Side by side

Amazon Nova Experimental Chat 11 10 and Claude Sonnet 4.5 specifications
Amazon Nova Experimental Chat 11 10Claude Sonnet 4.5
ProviderAmazonAnthropic
Noometry Index43.044.1
Released—2025-09-29
WeightsProprietaryProprietary
Context window—200K
Max output—64K
Input $ / M tokens—$3
Output $ / M tokens—$15
Results tracked1773

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 4.5 leads

Amazon Nova Experimental Chat 11 10: 42.3 (#107), Claude Sonnet 4.5: 47.3 (#61)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
LMArena Coding14331489
SWE-bench Verified—71.3%
SWE-bench Verified (bash only)—71.4%
LMArena WebDev—1393
SWE-bench Multilingual—67%
SciCode—44.7%
GSO—14.7%
WeirdML—47.7%
ALE-Bench—796.15
AlgoTune—1.52

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 11 10: —, Claude Sonnet 4.5: 38.3 (#32)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
Terminal-Bench—46.5%
Berkeley Function Calling Leaderboard—73.2%
GDPval—42.5%
Remote Labor Index—2.1%
τ²-bench Airline—72%
τ²-bench Banking—25.3%
τ²-bench Retail—72.4%
τ²-bench Telecom—84.9%
Cybench—60%
DeepResearch Bench—52.6%
OSWorld—62.9%
LMArena Search—1159
METR Time Horizons—67.4%
Vending-Bench 2—3,839

Reasoning Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 29.1 (#95), Claude Sonnet 4.5: 26.9 (#125)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
LMArena Hard Prompts14221462
ARC-AGI-2—13.6%
SimpleBench—54.3%
Kagi LLM Benchmark—57.9%
NYT Connections (extended)—37.3%
ARC-AGI-1—63.7%
CritPt—1.1%
Chess Puzzles—12%
EnigmaEval—6%
EBR-Bench—2.4%
Mystery Game Puzzles—17%
DTBench—83.2%
LMCA—38.8%
Epoch Capabilities Index—146.84
ForecastBench—61.9

Math Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 39.1 (#114), Claude Sonnet 4.5: 32.3 (#216)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
LMArena Math14311449
FrontierMath (Tiers 1-3)—23.9%
FrontierMath Tier 4—2.4%
OTIS Mock AIME 2024-2025—77.8%
ProofBench—19%
Omni-MATH—55.3%
MATH Level 5—97.7%
FrontierMath (Feb 2025 set)—15.2%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Claude Sonnet 4.5 leads

Amazon Nova Experimental Chat 11 10: 39.9 (#127), Claude Sonnet 4.5: 48.4 (#76)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
LMArena Expert14311482
GPQA Diamond—82.3%
Humanity's Last Exam—13.7%
SimpleQA Verified—30.7%
MMLU-Pro—86.9%
Vectara Hallucination Rate—12%
GPQA (HELM)—68.6%

Multimodal Not comparable

Amazon Nova Experimental Chat 11 10: —, Claude Sonnet 4.5: 34.8 (#89)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
VPCT—39.8%
LMArena Document—1450

Multilingual Claude Sonnet 4.5 leads

Amazon Nova Experimental Chat 11 10: 51.9 (#98), Claude Sonnet 4.5: 53.4 (#69)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
LMArena Non-English14051425
LMArena Chinese14631459
LMArena French14491458
LMArena German13951427
LMArena Japanese13831390
LMArena Korean13841403
LMArena Russian13941437
LMArena Spanish14441457

Instruction Following Claude Sonnet 4.5 leads

Amazon Nova Experimental Chat 11 10: 73.2 (#122), Claude Sonnet 4.5: 75.0 (#78)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
LMArena Instruction Following13871459
IFEval—85%

Long Context Claude Sonnet 4.5 leads

Amazon Nova Experimental Chat 11 10: 42.5 (#121), Claude Sonnet 4.5: 45.2 (#46)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
LMArena Longer Query13951476

Writing & Preference Claude Sonnet 4.5 leads

Amazon Nova Experimental Chat 11 10: 58.8 (#114), Claude Sonnet 4.5: 66.5 (#34)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Claude Sonnet 4.5
LMArena Text14151439
LMArena Creative Writing13491442
LMArena Multi-Turn13801465
EQ-Bench Creative Writing—1678
WildBench—85.4%

Frequently asked questions

Is Amazon Nova Experimental Chat 11 10 better than Claude Sonnet 4.5?

Claude Sonnet 4.5 is the stronger model overall, scoring 44.1 to 43.0 on the Noometry Index.

Is Amazon Nova Experimental Chat 11 10 or Claude Sonnet 4.5 better for coding?

Claude Sonnet 4.5 scores higher on coding benchmarks: 47.3 versus 42.3 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 11 10 and Claude Sonnet 4.5 share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 11 10 has 17 scored results on Noometry and Claude Sonnet 4.5 has 73.

Related comparisons

Go deeper