Model comparison

Claude 2 vs Nova Premier 1.0

Nova Premier 1.0 is the stronger model overall, scoring 37.7 to 24.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2 Anthropic

24.7

Rank #342 Reported

Nova Premier 1.0 Amazon

37.7

Rank #185 Confirmed

Summary

  • The widest gap is in math, where Nova Premier 1.0 leads 31.5 to 8.7.

Side by side

Claude 2 and Nova Premier 1.0 specifications
Claude 2Nova Premier 1.0
ProviderAnthropicAmazon
Noometry Index24.737.7
Released2023-07-112025-04-30
WeightsProprietaryProprietary
Context window—1M
Max output—10K
Input $ / M tokens—$2.50
Output $ / M tokens—$12.50
Results tracked86

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, Nova Premier 1.0: —

Coding benchmarks
BenchmarkClaude 2Nova Premier 1.0
HumanEval+61.6%—

Reasoning Nova Premier 1.0 leads

Claude 2: 20.8 (#213), Nova Premier 1.0: 22.3 (#182)

Reasoning benchmarks
BenchmarkClaude 2Nova Premier 1.0
Kagi LLM Benchmark—44.8%
DTBench51.9%—
Epoch Capabilities Index120.08—

Math Nova Premier 1.0 leads

Claude 2: 8.7 (#314), Nova Premier 1.0: 31.5 (#194)

Math benchmarks
BenchmarkClaude 2Nova Premier 1.0
OTIS Mock AIME 2024-20252.5%—
Omni-MATH—35%
MATH Level 511.7%—

Knowledge Nova Premier 1.0 leads

Claude 2: 17.0 (#282), Nova Premier 1.0: 35.4 (#176)

Knowledge benchmarks
BenchmarkClaude 2Nova Premier 1.0
GPQA Diamond34.7%—
MMLU-Pro—72.6%
GPQA (HELM)—51.8%
MMLU78.5%—
TriviaQA87.5%—

Instruction Following Not comparable

Claude 2: —, Nova Premier 1.0: 66.9 (#201)

Instruction Following benchmarks
BenchmarkClaude 2Nova Premier 1.0
IFEval—80.3%

Writing & Preference Not comparable

Claude 2: —, Nova Premier 1.0: 51.0 (#174)

Writing & Preference benchmarks
BenchmarkClaude 2Nova Premier 1.0
WildBench—78.8%

Frequently asked questions

Is Claude 2 better than Nova Premier 1.0?

Nova Premier 1.0 is the stronger model overall, scoring 37.7 to 24.7 on the Noometry Index.

How many benchmarks do Claude 2 and Nova Premier 1.0 share?

0 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper