Noometry

Model comparison

DeepSeek V4 Pro vs Grok 4 Fast

DeepSeek V4 Pro is the stronger model overall, scoring 54.2 to 39.0 on the Noometry Index.

Last verified . 26 shared benchmarks.

DeepSeek V4 Pro DeepSeek

54.2

Rank #28 Confirmed

Grok 4 Fast xAI

39.0

Rank #164 Confirmed

Summary

  • They share 26 benchmarks with published results for both. DeepSeek V4 Pro scores higher in 8 categories and Grok 4 Fast in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where DeepSeek V4 Pro leads 56.4 to 22.5.
  • The biggest single-benchmark swing is ARC-AGI-2: 61.3% for DeepSeek V4 Pro and 5.3% for Grok 4 Fast.
  • DeepSeek V4 Pro has downloadable open weights; the other is API-only.

Side by side

DeepSeek V4 ProGrok 4 Fast
ProviderDeepSeekxAI
Noometry Index54.239.0
Released2026-04-242025-09-19
WeightsOpenProprietary
Context window1M—
Max output393K—
Input $ / M tokens$0.43—
Output $ / M tokens$0.87—
Results tracked4830

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4 Pro leads

DeepSeek V4 Pro: 52.2 (#31), Grok 4 Fast: 32.3 (#264)

BenchmarkDeepSeek V4 ProGrok 4 Fast
LMArena WebDev15821160
WeirdML66.2%42.9%
LMArena Coding14701429
SWE-bench Verified77.6%—
FrontierCode28.6%—
SciCode51%—
ALE-Bench1,403—

Agentic & Tool Use DeepSeek V4 Pro leads

DeepSeek V4 Pro: 32.7 (#54), Grok 4 Fast: 29.3 (#80)

BenchmarkDeepSeek V4 ProGrok 4 Fast
APEX-Agents47.3%—
τ²-bench Banking—15.7%
Cybench—30%
LMArena Search—1171
Vending-Bench 23,285—

Reasoning DeepSeek V4 Pro leads

DeepSeek V4 Pro: 56.4 (#22), Grok 4 Fast: 22.5 (#179)

BenchmarkDeepSeek V4 ProGrok 4 Fast
ARC-AGI-261.3%5.3%
Kagi LLM Benchmark53.5%66.1%
ARC-AGI-190.5%48.5%
LMArena Hard Prompts14611413
DTBench93.9%82.7%
Epoch Capabilities Index155.39144.21
ForecastBench56.160.5
NYT Connections (extended)91.3%—
CritPt18%—
Chess Puzzles47%—
Mystery Game Puzzles43%—
LMCA45.5%—
Surface Evolver Bench40%—

Math DeepSeek V4 Pro leads

DeepSeek V4 Pro: 64.6 (#24), Grok 4 Fast: 36.1 (#126)

BenchmarkDeepSeek V4 ProGrok 4 Fast
LMArena Math14551419
FrontierMath (Tiers 1-3)64.6%—
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions76.6%—
OTIS Mock AIME 2024-202598.6%—
ProofBench50%—

Knowledge DeepSeek V4 Pro leads

DeepSeek V4 Pro: 59.5 (#28), Grok 4 Fast: 31.5 (#211)

BenchmarkDeepSeek V4 ProGrok 4 Fast
Vectara Hallucination Rate8.6%19.7%
LMArena Expert14631411
GPQA Diamond91.7%—
SimpleQA Verified52.9%—

Multilingual DeepSeek V4 Pro leads

DeepSeek V4 Pro: 54.5 (#44), Grok 4 Fast: 51.5 (#106)

BenchmarkDeepSeek V4 ProGrok 4 Fast
LMArena Non-English14381397
LMArena Chinese14861458
LMArena French14731433
LMArena German14581383
LMArena Japanese14481358
LMArena Korean14521359
LMArena Russian14521387
LMArena Spanish14571414

Instruction Following DeepSeek V4 Pro leads

DeepSeek V4 Pro: 76.3 (#44), Grok 4 Fast: 73.4 (#116)

BenchmarkDeepSeek V4 ProGrok 4 Fast
LMArena Instruction Following14481388

Long Context Grok 4 Fast leads

DeepSeek V4 Pro: 45.0 (#49), Grok 4 Fast: 63.2 (#3)

BenchmarkDeepSeek V4 ProGrok 4 Fast
LMArena Longer Query14591415
Fiction.LiveBench—94.4%
CL-bench Life13.5%—

Writing & Preference DeepSeek V4 Pro leads

DeepSeek V4 Pro: 65.6 (#45), Grok 4 Fast: 60.2 (#96)

BenchmarkDeepSeek V4 ProGrok 4 Fast
LMArena Text14511407
LMArena Creative Writing14461388
LMArena Multi-Turn14671414
EQ-Bench Creative Writing1553—
EQ-Bench 41166—

Frequently asked questions

Is DeepSeek V4 Pro better than Grok 4 Fast?

DeepSeek V4 Pro is the stronger model overall, scoring 54.2 to 39.0 on the Noometry Index.

Is DeepSeek V4 Pro or Grok 4 Fast better for coding?

DeepSeek V4 Pro scores higher on coding benchmarks: 52.2 versus 32.3 in the Noometry coding category.

How many benchmarks do DeepSeek V4 Pro and Grok 4 Fast share?

26 benchmarks have published results for both models. DeepSeek V4 Pro has 48 scored results on Noometry and Grok 4 Fast has 30.

Related comparisons

Go deeper