Model comparison

Amazon Nova Experimental Chat 11 10 vs Llama 3.2 90B

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 42.4 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Summary

  • The widest gap is in math, where Amazon Nova Experimental Chat 11 10 leads 36.4 to 10.4.
  • Llama 3.2 90B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 11 10 and Llama 3.2 90B specifications
Amazon Nova Experimental Chat 11 10Llama 3.2 90B
ProviderAmazonMeta
Noometry Index42.427.1
Released—2024-09-24
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked179

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Experimental Chat 11 10: 41.6 (#109), Llama 3.2 90B: —

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
LMArena Coding1433—

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 11 10: —, Llama 3.2 90B: 29.7 (#73)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
BALROG—27.3%

Reasoning Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 27.9 (#94), Llama 3.2 90B: 20.9 (#207)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
EnigmaEval—0.4%
LMArena Hard Prompts1422—
Epoch Capabilities Index—125.5

Math Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 36.4 (#116), Llama 3.2 90B: 10.4 (#302)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
OTIS Mock AIME 2024-2025—2.6%
LMArena Math1431—
MATH Level 5—39.4%

Knowledge Amazon Nova Experimental Chat 11 10 leads

Amazon Nova Experimental Chat 11 10: 39.3 (#122), Llama 3.2 90B: 21.7 (#269)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
GPQA Diamond—41%
LMArena Expert1432—
MMLU—80.3%

Multimodal Not comparable

Amazon Nova Experimental Chat 11 10: —, Llama 3.2 90B: 24.9 (#119)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
LMArena Vision—1000
GeoBench—52%

Multilingual Not comparable

Amazon Nova Experimental Chat 11 10: 52.1 (#91), Llama 3.2 90B: —

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
LMArena Non-English1405—
LMArena Chinese1463—
LMArena French1449—
LMArena German1396—
LMArena Japanese1383—
LMArena Korean1387—
LMArena Russian1395—
LMArena Spanish1444—

Instruction Following Not comparable

Amazon Nova Experimental Chat 11 10: 73.4 (#118), Llama 3.2 90B: —

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
LMArena Instruction Following1387—

Long Context Not comparable

Amazon Nova Experimental Chat 11 10: 42.5 (#116), Llama 3.2 90B: —

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
LMArena Longer Query1395—

Writing & Preference Not comparable

Amazon Nova Experimental Chat 11 10: 59.0 (#109), Llama 3.2 90B: —

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 11 10Llama 3.2 90B
LMArena Text1415—
LMArena Creative Writing1349—
LMArena Multi-Turn1380—

Frequently asked questions

Is Amazon Nova Experimental Chat 11 10 better than Llama 3.2 90B?

Amazon Nova Experimental Chat 11 10 is the stronger model overall, scoring 42.4 to 27.1 on the Noometry Index.

How many benchmarks do Amazon Nova Experimental Chat 11 10 and Llama 3.2 90B share?

0 benchmarks have published results for both models. Amazon Nova Experimental Chat 11 10 has 17 scored results on Noometry and Llama 3.2 90B has 9.

Related comparisons

Go deeper