Model comparison

Claude 2.1 vs Nova Premier 1.0

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 25.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

Nova Premier 1.0 Amazon

38.3

Rank #189 Confirmed

Summary

  • The widest gap is in math, where Nova Premier 1.0 leads 33.8 to 10.2.

Side by side

Claude 2.1 and Nova Premier 1.0 specifications
Claude 2.1Nova Premier 1.0
ProviderAnthropicAmazon
Noometry Index25.238.3
Released2023-11-212025-04-30
WeightsProprietaryProprietary
Context window—1M
Max output—10K
Input $ / M tokens—$2.50
Output $ / M tokens—$12.50
Results tracked76

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2.1: 26.2 (#327), Nova Premier 1.0: —

Coding benchmarks
BenchmarkClaude 2.1Nova Premier 1.0
WeirdML7.1%—

Reasoning Nova Premier 1.0 leads

Claude 2.1: 21.4 (#221), Nova Premier 1.0: 23.0 (#185)

Reasoning benchmarks
BenchmarkClaude 2.1Nova Premier 1.0
Kagi LLM Benchmark—44.8%
DTBench51%—
Epoch Capabilities Index119.27—
ForecastBench54.2—

Math Nova Premier 1.0 leads

Claude 2.1: 10.2 (#315), Nova Premier 1.0: 33.8 (#199)

Math benchmarks
BenchmarkClaude 2.1Nova Premier 1.0
OTIS Mock AIME 2024-20251.9%—
Omni-MATH—35%

Knowledge Nova Premier 1.0 leads

Claude 2.1: 15.4 (#292), Nova Premier 1.0: 35.8 (#180)

Knowledge benchmarks
BenchmarkClaude 2.1Nova Premier 1.0
GPQA Diamond33%—
MMLU-Pro—72.6%
GPQA (HELM)—51.8%
MMLU73.5%—

Instruction Following Not comparable

Claude 2.1: —, Nova Premier 1.0: 66.8 (#204)

Instruction Following benchmarks
BenchmarkClaude 2.1Nova Premier 1.0
IFEval—80.3%

Writing & Preference Not comparable

Claude 2.1: —, Nova Premier 1.0: 51.0 (#178)

Writing & Preference benchmarks
BenchmarkClaude 2.1Nova Premier 1.0
WildBench—78.8%

Frequently asked questions

Is Claude 2.1 better than Nova Premier 1.0?

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 25.2 on the Noometry Index.

How many benchmarks do Claude 2.1 and Nova Premier 1.0 share?

0 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper