Model comparison

Amazon Nova Experimental Chat 11 10 vs Llama 4 Scout

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 27.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

Llama 4 Scout Meta

27.7

Rank #330 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 11 10 scores higher in 8 categories and Llama 4 Scout in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Amazon Nova Experimental Chat 11 10 leads 42.3 to 20.2.
  • Llama 4 Scout has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 11 10 and Llama 4 Scout specifications
Amazon Nova Experimental Chat 11 10Llama 4 Scout
ProviderAmazonMeta
Noometry Index43.027.7
Released—2025-04-05
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked1743

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.3 (#107), Llama 4 Scout: 20.2 (#339)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
LMArena Coding14331286
SWE-bench Verified (bash only)—9.1%
SciCode—17%
BigCodeBench Complete—43.1%

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 11 10: —, Llama 4 Scout: 24.6 (#119)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
Berkeley Function Calling Leaderboard—28.1%

Reasoning Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 29.1 (#95), Llama 4 Scout: 9.1 (#345)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
LMArena Hard Prompts14221266
ARC-AGI-2—0%
Kagi LLM Benchmark—36.9%
ARC-AGI-1—0.5%
CritPt—0%
DTBench—57.9%
LMCA—12%
Epoch Capabilities Index—129.64
ForecastBench—57.5

Math Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 39.1 (#114), Llama 4 Scout: 19.6 (#286)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
LMArena Math14311287
OTIS Mock AIME 2024-2025—7.8%
Omni-MATH—37.3%
MATH Level 5—62.3%
FrontierMath (Feb 2025 set)—0%

Knowledge Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 39.9 (#127), Llama 4 Scout: 31.9 (#217)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
LMArena Expert14311235
GPQA Diamond—51.8%
MMLU-Pro—74.2%
Vectara Hallucination Rate—7.7%
GPQA (HELM)—50.7%

Multimodal Not comparable

Amazon Nova Experimental Chat 11 10: —, Llama 4 Scout: 32.2 (#102)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
LMArena Vision—1118
SpatialViz-Bench—34.2%

Multilingual Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 51.9 (#98), Llama 4 Scout: 41.0 (#212)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
LMArena Non-English14051252
LMArena Chinese14631255
LMArena French14491282
LMArena German13951272
LMArena Japanese13831206
LMArena Korean13841207
LMArena Russian13941263
LMArena Spanish14441278

Instruction Following Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 73.2 (#122), Llama 4 Scout: 65.8 (#217)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
LMArena Instruction Following13871248
IFEval—81.8%

Long Context Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 42.5 (#121), Llama 4 Scout: 27.5 (#294)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
LMArena Longer Query13951265
Fiction.LiveBench—36%

Writing & Preference Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 58.8 (#114), Llama 4 Scout: 37.0 (#261)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 4 Scout
LMArena Text14151279
LMArena Creative Writing13491249
LMArena Multi-Turn13801280
EQ-Bench Creative Writing—783
WildBench—78%

Frequently asked questions

Is Amazon Nova Experimental Chat 11 10 better than Llama 4 Scout?

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 43.0 to 27.7 on the Noometry Index.

Is Amazon Nova Experimental Chat 11 10 or Llama 4 Scout better for coding?

Amazon Nova Experimental Chat 11 10 scores higher on coding benchmarks: 42.3 versus 20.2 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 11 10 and Llama 4 Scout share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 11 10 has 17 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper