Noometry

Model comparison

DeepSeek V4 Pro vs Qwen3.8 27B

DeepSeek V4 Pro is the stronger model overall, scoring 54.3 to 46.0 on the Noometry Index.

Last verified . 30 shared benchmarks.

DeepSeek V4 Pro DeepSeek

54.3

Rank #31 Confirmed

Qwen3.8 27B Alibaba (Qwen)

46.0

Rank #68 Confirmed

Summary

  • They share 30 benchmarks with published results for both. DeepSeek V4 Pro scores higher in 7 categories and Qwen3.8 27B in 2 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek V4 Pro leads 64.8 to 37.1.
  • The biggest single-benchmark swing is NYT Connections (extended): 91.3% for DeepSeek V4 Pro and 54.5% for Qwen3.8 27B.
  • DeepSeek V4 Pro is cheaper at $0.66 / $1.98 per million input/output tokens, against $0.99 / $1.49 for Qwen3.8 27B.
  • DeepSeek V4 Pro accepts more context: 1M tokens versus 262K.

Side by side

DeepSeek V4 ProQwen3.8 27B
ProviderDeepSeekAlibaba (Qwen)
Noometry Index54.346.0
Released2026-04-242026-08-14
WeightsOpenOpen
Context window1M262K
Max output393K33K
Input $ / M tokens$0.66$0.99
Output $ / M tokens$1.98$1.49
Results tracked4831

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4 Pro leads

DeepSeek V4 Pro: 52.4 (#34), Qwen3.8 27B: 50.5 (#44)

BenchmarkDeepSeek V4 ProQwen3.8 27B
LMArena WebDev15821593
SciCode51%46.6%
LMArena Coding14701482
SWE-bench Verified77.6%—
FrontierCode28.6%—
WeirdML66.2%—
ALE-Bench1,403—

Agentic & Tool Use Too close to call

DeepSeek V4 Pro: 32.8 (#58), Qwen3.8 27B: 32.9 (#57)

BenchmarkDeepSeek V4 ProQwen3.8 27B
APEX-Agents47.3%47.5%
Vending-Bench 23,285—

Reasoning DeepSeek V4 Pro leads

DeepSeek V4 Pro: 56.5 (#24), Qwen3.8 27B: 41.0 (#54)

BenchmarkDeepSeek V4 ProQwen3.8 27B
ARC-AGI-261.3%42.4%
NYT Connections (extended)91.3%54.5%
ARC-AGI-190.5%87.5%
CritPt18%5.4%
LMArena Hard Prompts14611460
DTBench93.9%88%
LMCA45.5%41.4%
Surface Evolver Bench40%45%
Epoch Capabilities Index155.31149.38
Kagi LLM Benchmark53.5%—
Chess Puzzles47%—
Mystery Game Puzzles43%—
ForecastBench56.1—

Math DeepSeek V4 Pro leads

DeepSeek V4 Pro: 64.8 (#30), Qwen3.8 27B: 37.1 (#161)

BenchmarkDeepSeek V4 ProQwen3.8 27B
ProofBench50%16%
LMArena Math14551456
FrontierMath (Tiers 1-3)64.6%—
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions76.6%—
OTIS Mock AIME 2024-202598.6%—

Knowledge DeepSeek V4 Pro leads

DeepSeek V4 Pro: 59.5 (#31), Qwen3.8 27B: 41.6 (#109)

BenchmarkDeepSeek V4 ProQwen3.8 27B
LMArena Expert14641482
GPQA Diamond91.7%—
SimpleQA Verified52.9%—
Vectara Hallucination Rate8.6%—

Multimodal Not comparable

DeepSeek V4 Pro: —, Qwen3.8 27B: 41.3 (#37)

BenchmarkDeepSeek V4 ProQwen3.8 27B
LMArena Vision—1271

Multilingual Too close to call

DeepSeek V4 Pro: 54.4 (#45), Qwen3.8 27B: 53.7 (#60)

BenchmarkDeepSeek V4 ProQwen3.8 27B
LMArena Non-English14391430
LMArena Chinese14861504
LMArena French14721465
LMArena German14581438
LMArena Japanese14451384
LMArena Korean14471393
LMArena Russian14531415
LMArena Spanish14581448

Instruction Following Too close to call

DeepSeek V4 Pro: 76.1 (#47), Qwen3.8 27B: 75.8 (#53)

BenchmarkDeepSeek V4 ProQwen3.8 27B
LMArena Instruction Following14481439

Long Context Too close to call

DeepSeek V4 Pro: 45.0 (#51), Qwen3.8 27B: 44.3 (#70)

BenchmarkDeepSeek V4 ProQwen3.8 27B
LMArena Longer Query14581450
CL-bench Life13.5%—

Writing & Preference Too close to call

DeepSeek V4 Pro: 65.5 (#46), Qwen3.8 27B: 65.8 (#43)

BenchmarkDeepSeek V4 ProQwen3.8 27B
LMArena Text14511441
LMArena Creative Writing14461384
EQ-Bench Creative Writing15531671
LMArena Multi-Turn14671441
EQ-Bench 41166—

Frequently asked questions

Is DeepSeek V4 Pro better than Qwen3.8 27B?

DeepSeek V4 Pro is the stronger model overall, scoring 54.3 to 46.0 on the Noometry Index.

Which is cheaper, DeepSeek V4 Pro or Qwen3.8 27B?

DeepSeek V4 Pro is cheaper. It lists at $0.66 per million input tokens and $1.98 per million output tokens; Qwen3.8 27B lists at $0.99 and $1.49.

Is DeepSeek V4 Pro or Qwen3.8 27B better for coding?

DeepSeek V4 Pro scores higher on coding benchmarks: 52.4 versus 50.5 in the Noometry coding category.

Which has the bigger context window?

DeepSeek V4 Pro does, with 1M tokens against 262K.

How many benchmarks do DeepSeek V4 Pro and Qwen3.8 27B share?

30 benchmarks have published results for both models. DeepSeek V4 Pro has 48 scored results on Noometry and Qwen3.8 27B has 31.

Related comparisons

Go deeper