Model comparison

DeepSeek-R1 vs Qwen Max

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 34.7 on the Noometry Index.

Last verified . 22 shared benchmarks.

DeepSeek-R1 DeepSeek

42.3

Rank #115 Confirmed

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Summary

  • They share 22 benchmarks with published results for both. DeepSeek-R1 scores higher in 7 categories and Qwen Max in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek-R1 leads 43.8 to 22.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 66.4% for DeepSeek-R1 and 16.1% for Qwen Max.
  • DeepSeek-R1 is cheaper at $0.50 / $2.15 per million input/output tokens, against $1.60 / $6.40 for Qwen Max.
  • DeepSeek-R1 accepts more context: 164K tokens versus 33K.

Side by side

DeepSeek-R1 and Qwen Max specifications
DeepSeek-R1Qwen Max
ProviderDeepSeekAlibaba (Qwen)
Noometry Index42.334.7
Released2025-01-202024-04-03
WeightsProprietaryProprietary
Context window164K33K
Max output64K8K
Input $ / M tokens$0.50$1.60
Output $ / M tokens$2.15$6.40
Results tracked5223

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-R1 leads

DeepSeek-R1: 46.3 (#68), Qwen Max: 30.7 (#292)

Coding benchmarks
BenchmarkDeepSeek-R1Qwen Max
Aider Polyglot71.4%21.8%
LMArena Coding14271288
SciCode35.7%—
WeirdML41.6%—
LiveBench Coding66.7%—
ALE-Bench804.12—
AlgoTune1.7—

Agentic & Tool Use Not comparable

DeepSeek-R1: 30.7 (#75), Qwen Max: —

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-R1Qwen Max
DeepResearch Bench35.1%—
BALROG34.9%—
METR Time Horizons53.8%—

Reasoning Qwen Max leads

DeepSeek-R1: 18.6 (#278), Qwen Max: 25.1 (#151)

Reasoning benchmarks
BenchmarkDeepSeek-R1Qwen Max
LMArena Hard Prompts14161269
ARC-AGI-21.3%—
SimpleBench40.8%—
Kagi LLM Benchmark69.4%—
ARC-AGI-121.2%—
CritPt1.1%—
LiveBench Reasoning83.2%—
LiveBench Data Analysis69.8%—
Epoch Capabilities Index141.29—
ForecastBench60—
LiveBench71.6%—

Math DeepSeek-R1 leads

DeepSeek-R1: 43.8 (#79), Qwen Max: 22.3 (#276)

Math benchmarks
BenchmarkDeepSeek-R1Qwen Max
OTIS Mock AIME 2024-202566.4%16.1%
LMArena Math14001275
MATH Level 596.6%67.2%
Omni-MATH42.4%—
LiveBench Math80.7%—
FrontierMath (Feb 2025 set)—1%

Knowledge DeepSeek-R1 leads

DeepSeek-R1: 44.5 (#87), Qwen Max: 30.3 (#228)

Knowledge benchmarks
BenchmarkDeepSeek-R1Qwen Max
GPQA Diamond76.3%56.1%
LMArena Expert13941248
MMLU-Pro79.3%—
Confabulations12.7%—
Vectara Hallucination Rate11.3%—
GPQA (HELM)66.6%—

Multilingual DeepSeek-R1 leads

DeepSeek-R1: 52.4 (#85), Qwen Max: 41.8 (#202)

Multilingual benchmarks
BenchmarkDeepSeek-R1Qwen Max
LMArena Non-English14121263
LMArena Chinese14421254
LMArena French14171330
LMArena German14041254
LMArena Japanese13911205
LMArena Korean13601142
LMArena Russian14231274
LMArena Spanish14111290

Instruction Following DeepSeek-R1 leads

DeepSeek-R1: 72.0 (#143), Qwen Max: 66.5 (#208)

Instruction Following benchmarks
BenchmarkDeepSeek-R1Qwen Max
LMArena Instruction Following13821262
LiveBench Instruction Following80.5%—
IFEval78.4%—

Long Context DeepSeek-R1 leads

DeepSeek-R1: 45.4 (#36), Qwen Max: 39.4 (#180)

Long Context benchmarks
BenchmarkDeepSeek-R1Qwen Max
Fiction.LiveBench75%66.7%
LMArena Longer Query13911288

Writing & Preference DeepSeek-R1 leads

DeepSeek-R1: 61.4 (#88), Qwen Max: 47.8 (#205)

Writing & Preference benchmarks
BenchmarkDeepSeek-R1Qwen Max
LMArena Text14281282
LMArena Creative Writing14051248
LMArena Multi-Turn14051277
Short-Story Creative Writing83%—
EQ-Bench Creative Writing1500—
WildBench82.8%—
LiveBench Language48.5%—

Frequently asked questions

Is DeepSeek-R1 better than Qwen Max?

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 34.7 on the Noometry Index.

Which is cheaper, DeepSeek-R1 or Qwen Max?

DeepSeek-R1 is cheaper. It lists at $0.50 per million input tokens and $2.15 per million output tokens; Qwen Max lists at $1.60 and $6.40.

Is DeepSeek-R1 or Qwen Max better for coding?

DeepSeek-R1 scores higher on coding benchmarks: 46.3 versus 30.7 in the Noometry coding category.

Which has the bigger context window?

DeepSeek-R1 does, with 164K tokens against 33K.

How many benchmarks do DeepSeek-R1 and Qwen Max share?

22 benchmarks have published results for both models. DeepSeek-R1 has 52 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper