Model comparison

DeepSeek-R1 vs Nova Premier 1.0

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 38.3 on the Noometry Index.

Last verified . 6 shared benchmarks.

DeepSeek-R1 DeepSeek

42.3

Rank #115 Confirmed

Nova Premier 1.0 Amazon

38.3

Rank #189 Confirmed

Summary

  • They share 6 benchmarks with published results for both. DeepSeek-R1 scores higher in 4 categories and Nova Premier 1.0 in 1 category; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where DeepSeek-R1 leads 61.4 to 51.0.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 69.4% for DeepSeek-R1 and 44.8% for Nova Premier 1.0.
  • DeepSeek-R1 is cheaper at $0.50 / $2.15 per million input/output tokens, against $2.50 / $12.50 for Nova Premier 1.0.
  • Nova Premier 1.0 accepts more context: 1M tokens versus 164K.

Side by side

DeepSeek-R1 and Nova Premier 1.0 specifications
DeepSeek-R1Nova Premier 1.0
ProviderDeepSeekAmazon
Noometry Index42.338.3
Released2025-01-202025-04-30
WeightsProprietaryProprietary
Context window164K1M
Max output64K10K
Input $ / M tokens$0.50$2.50
Output $ / M tokens$2.15$12.50
Results tracked526

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DeepSeek-R1: 46.3 (#68), Nova Premier 1.0: —

Coding benchmarks
BenchmarkDeepSeek-R1Nova Premier 1.0
Aider Polyglot71.4%—
SciCode35.7%—
WeirdML41.6%—
LiveBench Coding66.7%—
LMArena Coding1427—
ALE-Bench804.12—
AlgoTune1.7—

Agentic & Tool Use Not comparable

DeepSeek-R1: 30.7 (#75), Nova Premier 1.0: —

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-R1Nova Premier 1.0
DeepResearch Bench35.1%—
BALROG34.9%—
METR Time Horizons53.8%—

Reasoning Nova Premier 1.0 leads

DeepSeek-R1: 18.6 (#278), Nova Premier 1.0: 23.0 (#185)

Reasoning benchmarks
BenchmarkDeepSeek-R1Nova Premier 1.0
Kagi LLM Benchmark69.4%44.8%
ARC-AGI-21.3%—
SimpleBench40.8%—
ARC-AGI-121.2%—
CritPt1.1%—
LiveBench Reasoning83.2%—
LMArena Hard Prompts1416—
LiveBench Data Analysis69.8%—
Epoch Capabilities Index141.29—
ForecastBench60—
LiveBench71.6%—

Math DeepSeek-R1 leads

DeepSeek-R1: 43.8 (#79), Nova Premier 1.0: 33.8 (#199)

Math benchmarks
BenchmarkDeepSeek-R1Nova Premier 1.0
Omni-MATH42.4%35%
OTIS Mock AIME 2024-202566.4%—
LiveBench Math80.7%—
LMArena Math1400—
MATH Level 596.6%—

Knowledge DeepSeek-R1 leads

DeepSeek-R1: 44.5 (#87), Nova Premier 1.0: 35.8 (#180)

Knowledge benchmarks
BenchmarkDeepSeek-R1Nova Premier 1.0
MMLU-Pro79.3%72.6%
GPQA (HELM)66.6%51.8%
GPQA Diamond76.3%—
Confabulations12.7%—
Vectara Hallucination Rate11.3%—
LMArena Expert1394—

Multilingual Not comparable

DeepSeek-R1: 52.4 (#85), Nova Premier 1.0: —

Multilingual benchmarks
BenchmarkDeepSeek-R1Nova Premier 1.0
LMArena Non-English1412—
LMArena Chinese1442—
LMArena French1417—
LMArena German1404—
LMArena Japanese1391—
LMArena Korean1360—
LMArena Russian1423—
LMArena Spanish1411—

Instruction Following DeepSeek-R1 leads

DeepSeek-R1: 72.0 (#143), Nova Premier 1.0: 66.8 (#204)

Instruction Following benchmarks
BenchmarkDeepSeek-R1Nova Premier 1.0
IFEval78.4%80.3%
LiveBench Instruction Following80.5%—
LMArena Instruction Following1382—

Long Context Not comparable

DeepSeek-R1: 45.4 (#36), Nova Premier 1.0: —

Long Context benchmarks
BenchmarkDeepSeek-R1Nova Premier 1.0
Fiction.LiveBench75%—
LMArena Longer Query1391—

Writing & Preference DeepSeek-R1 leads

DeepSeek-R1: 61.4 (#88), Nova Premier 1.0: 51.0 (#178)

Writing & Preference benchmarks
BenchmarkDeepSeek-R1Nova Premier 1.0
WildBench82.8%78.8%
LMArena Text1428—
LMArena Creative Writing1405—
Short-Story Creative Writing83%—
EQ-Bench Creative Writing1500—
LMArena Multi-Turn1405—
LiveBench Language48.5%—

Frequently asked questions

Is DeepSeek-R1 better than Nova Premier 1.0?

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 38.3 on the Noometry Index.

Which is cheaper, DeepSeek-R1 or Nova Premier 1.0?

DeepSeek-R1 is cheaper. It lists at $0.50 per million input tokens and $2.15 per million output tokens; Nova Premier 1.0 lists at $2.50 and $12.50.

Which has the bigger context window?

Nova Premier 1.0 does, with 1M tokens against 164K.

How many benchmarks do DeepSeek-R1 and Nova Premier 1.0 share?

6 benchmarks have published results for both models. DeepSeek-R1 has 52 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper