Model comparison

DeepSeek-R1 vs Qwen3-4B

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 31.9 on the Noometry Index.

Last verified . 3 shared benchmarks.

DeepSeek-R1 DeepSeek

42.3

Rank #115 Confirmed

Qwen3-4B Alibaba (Qwen)

31.9

Rank #264 Confirmed

Summary

  • They share 3 benchmarks with published results for both. DeepSeek-R1 scores higher in 3 categories and Qwen3-4B in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek-R1 leads 43.8 to 29.7.
  • The biggest single-benchmark swing is GPQA Diamond: 76.3% for DeepSeek-R1 and 52.3% for Qwen3-4B.
  • Qwen3-4B has downloadable open weights; the other is API-only.

Side by side

DeepSeek-R1 and Qwen3-4B specifications
DeepSeek-R1Qwen3-4B
ProviderDeepSeekAlibaba (Qwen)
Noometry Index42.331.9
Released2025-01-202025-04-29
WeightsProprietaryOpen
Context window164K—
Max output64K—
Input $ / M tokens$0.50—
Output $ / M tokens$2.15—
Results tracked526

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DeepSeek-R1: 46.3 (#68), Qwen3-4B: —

Coding benchmarks
BenchmarkDeepSeek-R1Qwen3-4B
Aider Polyglot71.4%—
SciCode35.7%—
WeirdML41.6%—
LiveBench Coding66.7%—
LMArena Coding1427—
ALE-Bench804.12—
AlgoTune1.7—

Agentic & Tool Use DeepSeek-R1 leads

DeepSeek-R1: 30.7 (#75), Qwen3-4B: 27.6 (#100)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-R1Qwen3-4B
Berkeley Function Calling Leaderboard—35.7%
DeepResearch Bench35.1%—
BALROG34.9%—
METR Time Horizons53.8%—

Reasoning Too close to call

DeepSeek-R1: 18.6 (#278), Qwen3-4B: 19.2 (#268)

Reasoning benchmarks
BenchmarkDeepSeek-R1Qwen3-4B
ARC-AGI-21.3%—
SimpleBench40.8%—
Kagi LLM Benchmark69.4%—
ARC-AGI-121.2%—
CritPt1.1%—
Chess Puzzles—4%
LiveBench Reasoning83.2%—
LMArena Hard Prompts1416—
LiveBench Data Analysis69.8%—
Epoch Capabilities Index141.29—
ForecastBench60—
LiveBench71.6%—

Math DeepSeek-R1 leads

DeepSeek-R1: 43.8 (#79), Qwen3-4B: 29.7 (#240)

Math benchmarks
BenchmarkDeepSeek-R1Qwen3-4B
OTIS Mock AIME 2024-202566.4%52.2%
MathArena Final-Answer Competitions—38.5%
Omni-MATH42.4%—
LiveBench Math80.7%—
LMArena Math1400—
MATH Level 596.6%—

Knowledge DeepSeek-R1 leads

DeepSeek-R1: 44.5 (#87), Qwen3-4B: 33.0 (#208)

Knowledge benchmarks
BenchmarkDeepSeek-R1Qwen3-4B
GPQA Diamond76.3%52.3%
Vectara Hallucination Rate11.3%5.7%
MMLU-Pro79.3%—
Confabulations12.7%—
GPQA (HELM)66.6%—
LMArena Expert1394—

Multilingual Not comparable

DeepSeek-R1: 52.4 (#85), Qwen3-4B: —

Multilingual benchmarks
BenchmarkDeepSeek-R1Qwen3-4B
LMArena Non-English1412—
LMArena Chinese1442—
LMArena French1417—
LMArena German1404—
LMArena Japanese1391—
LMArena Korean1360—
LMArena Russian1423—
LMArena Spanish1411—

Instruction Following Not comparable

DeepSeek-R1: 72.0 (#143), Qwen3-4B: —

Instruction Following benchmarks
BenchmarkDeepSeek-R1Qwen3-4B
LiveBench Instruction Following80.5%—
IFEval78.4%—
LMArena Instruction Following1382—

Long Context Not comparable

DeepSeek-R1: 45.4 (#36), Qwen3-4B: —

Long Context benchmarks
BenchmarkDeepSeek-R1Qwen3-4B
Fiction.LiveBench75%—
LMArena Longer Query1391—

Writing & Preference Not comparable

DeepSeek-R1: 61.4 (#88), Qwen3-4B: —

Writing & Preference benchmarks
BenchmarkDeepSeek-R1Qwen3-4B
LMArena Text1428—
LMArena Creative Writing1405—
Short-Story Creative Writing83%—
EQ-Bench Creative Writing1500—
WildBench82.8%—
LMArena Multi-Turn1405—
LiveBench Language48.5%—

Frequently asked questions

Is DeepSeek-R1 better than Qwen3-4B?

DeepSeek-R1 is the stronger model overall, scoring 42.3 to 31.9 on the Noometry Index.

How many benchmarks do DeepSeek-R1 and Qwen3-4B share?

3 benchmarks have published results for both models. DeepSeek-R1 has 52 scored results on Noometry and Qwen3-4B has 6.

Related comparisons

Go deeper