Model comparison

Amazon Nova Experimental Chat 26 01 10 vs GPT-5.6 Sol

GPT-5.6 Sol is the stronger model overall, scoring 65.0 to 42.8 on the Noometry Index.

Last verified . 13 shared benchmarks.

GPT-5.6 Sol OpenAI

65.0

Rank #7 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Amazon Nova Experimental Chat 26 01 10 scores higher in 0 categories and GPT-5.6 Sol in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Sol leads 85.6 to 38.5.

Side by side

Amazon Nova Experimental Chat 26 01 10 and GPT-5.6 Sol specifications
Amazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
ProviderAmazonOpenAI
Noometry Index42.865.0
Released—2026-07-09
WeightsProprietaryProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$4
Output $ / M tokens—$20
Results tracked1365

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Sol leads

Amazon Nova Experimental Chat 26 01 10: 42.7 (#96), GPT-5.6 Sol: 65.1 (#7)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
LMArena Coding14471498
DeepSWE—72.7%
FrontierCode—47.5%
CursorBench—41.7%
LMArena WebDev—1618
FrontierSWE—32.2%
SciCode—57.1%
GSO—76.5%
WeirdML—89.4%
MirrorCode—20%
ALE-Bench—2,177

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 26 01 10: —, GPT-5.6 Sol: 50.3 (#7)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
APEX-Agents—51.4%
OSWorld 2.0—27.3%
τ²-bench Banking—46.9%
PostTrainBench—36.2%
BALROG—60%
GBAEval—52.6%
GDP.pdf—30.7%
LMArena Search—1257
Vending-Bench 2—9,619

Reasoning GPT-5.6 Sol leads

Amazon Nova Experimental Chat 26 01 10: 28.9 (#98), GPT-5.6 Sol: 74.8 (#8)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
LMArena Hard Prompts14151484
ARC-AGI-2—92.5%
SimpleBench—71.7%
Kagi LLM Benchmark—67%
NYT Connections (extended)—93.8%
ARC-AGI-1—97.5%
CritPt—32.3%
Chess Puzzles—64%
EnigmaEval—37.1%
EBR-Bench—44.8%
Mystery Game Puzzles—58%
DTBench—96%
LMCA—59.2%
Surface Evolver Bench—93.1%
Bench to the Future 3—0.14
Epoch Capabilities Index—161.66

Math GPT-5.6 Sol leads

Amazon Nova Experimental Chat 26 01 10: 38.5 (#136), GPT-5.6 Sol: 85.6 (#9)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
LMArena Math14041474
FrontierMath (Tiers 1-3)—89.1%
FrontierMath Tier 4—82.9%
OTIS Mock AIME 2024-2025—100%
ProofBench—83%
FrontierMath Erdős—0%

Knowledge GPT-5.6 Sol leads

Amazon Nova Experimental Chat 26 01 10: 40.3 (#120), GPT-5.6 Sol: 64.3 (#18)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
LMArena Expert14441516
GPQA Diamond—93.5%
SimpleQA Verified—69.7%
Vectara Hallucination Rate—12.4%

Multimodal Not comparable

Amazon Nova Experimental Chat 26 01 10: —, GPT-5.6 Sol: 48.6 (#9)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
LMArena Vision—1281
Blueprint-Bench 2—33.6%
Furniture Assembly—56.7%
LMArena Document—1483

Multilingual GPT-5.6 Sol leads

Amazon Nova Experimental Chat 26 01 10: 50.2 (#126), GPT-5.6 Sol: 55.3 (#32)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
LMArena Non-English13811452
LMArena Chinese13721527
LMArena Russian13911468
LMArena Spanish13901441
LMArena French—1477
LMArena German—1476
LMArena Japanese—1471
LMArena Korean—1442

Instruction Following GPT-5.6 Sol leads

Amazon Nova Experimental Chat 26 01 10: 72.9 (#126), GPT-5.6 Sol: 77.7 (#16)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
LMArena Instruction Following13811482

Long Context GPT-5.6 Sol leads

Amazon Nova Experimental Chat 26 01 10: 42.7 (#119), GPT-5.6 Sol: 45.4 (#42)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
LMArena Longer Query14001480

Writing & Preference GPT-5.6 Sol leads

Amazon Nova Experimental Chat 26 01 10: 57.4 (#129), GPT-5.6 Sol: 73.3 (#12)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 01 10GPT-5.6 Sol
LMArena Text13961457
LMArena Creative Writing13311448
LMArena Multi-Turn13801460
EQ-Bench Creative Writing—1972
EQ-Bench 4—1250

Frequently asked questions

Is Amazon Nova Experimental Chat 26 01 10 better than GPT-5.6 Sol?

GPT-5.6 Sol is the stronger model overall, scoring 65.0 to 42.8 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 01 10 or GPT-5.6 Sol better for coding?

GPT-5.6 Sol scores higher on coding benchmarks: 65.1 versus 42.7 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 01 10 and GPT-5.6 Sol share?

13 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 01 10 has 13 scored results on Noometry and GPT-5.6 Sol has 65.

Related comparisons

Go deeper