Noometry

Model comparison

DeepSeek V4 Flash vs Grok 4.1 Fast

DeepSeek V4 Flash is the stronger model overall, scoring 53.6 to 41.4 on the Noometry Index.

Last verified . 25 shared benchmarks.

DeepSeek V4 Flash DeepSeek

53.6

Rank #35 Confirmed

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Summary

  • They share 25 benchmarks with published results for both. DeepSeek V4 Flash scores higher in 8 categories and Grok 4.1 Fast in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek V4 Flash leads 60.3 to 31.9.
  • The biggest single-benchmark swing is ProofBench: 56% for DeepSeek V4 Flash and 4% for Grok 4.1 Fast.
  • Both cost about the same: $0.15 input and $0.60 output per million tokens.
  • DeepSeek V4 Flash accepts more context: 1M tokens versus 128K.
  • DeepSeek V4 Flash has downloadable open weights; the other is API-only.

Side by side

DeepSeek V4 FlashGrok 4.1 Fast
ProviderDeepSeekxAI
Noometry Index53.641.4
Released2026-04-242025-06-27
WeightsOpenProprietary
Context window1M128K
Max output393K30K
Input $ / M tokens$0.15$0.20
Output $ / M tokens$0.60$0.50
Results tracked4132

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4 Flash leads

DeepSeek V4 Flash: 47.9 (#59), Grok 4.1 Fast: 34.1 (#245)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
LMArena WebDev15821242
LMArena Coding14571411
ALE-Bench1,306394.93
FrontierCode18.8%—
SciCode49.9%—
WeirdML63%—

Agentic & Tool Use Not comparable

DeepSeek V4 Flash: —, Grok 4.1 Fast: 36.3 (#39)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
Berkeley Function Calling Leaderboard—69.6%
τ²-bench Banking—13.1%
LMArena Search—1171
Vending-Bench 2—1,107

Reasoning DeepSeek V4 Flash leads

DeepSeek V4 Flash: 53.7 (#30), Grok 4.1 Fast: 43.4 (#49)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
SimpleBench61.1%56%
NYT Connections (extended)89.6%87.4%
LMArena Hard Prompts14441407
DTBench90.9%87.7%
ARC-AGI-261.4%—
Kagi LLM Benchmark52.2%—
ARC-AGI-189%—
CritPt16.6%—
Chess Puzzles33%—
Mystery Game Puzzles34%—
LMCA41.7%—
Epoch Capabilities Index154.49—
ForecastBench—61

Math DeepSeek V4 Flash leads

DeepSeek V4 Flash: 60.3 (#37), Grok 4.1 Fast: 31.9 (#221)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
MathArena Final-Answer Competitions76.5%60.9%
ProofBench56%4%
LMArena Math14271408
FrontierMath (Tiers 1-3)57.5%—
FrontierMath Tier 424.4%—
OTIS Mock AIME 2024-202594.4%—

Knowledge DeepSeek V4 Flash leads

DeepSeek V4 Flash: 55.4 (#48), Grok 4.1 Fast: 33.1 (#207)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
LMArena Expert14411399
GPQA Diamond91%—
SimpleQA Verified33.6%—
Vectara Hallucination Rate—17.8%

Multimodal Not comparable

DeepSeek V4 Flash: —, Grok 4.1 Fast: 37.0 (#76)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
LMArena Vision—1201

Multilingual DeepSeek V4 Flash leads

DeepSeek V4 Flash: 53.0 (#72), Grok 4.1 Fast: 51.0 (#114)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
LMArena Non-English14201391
LMArena Chinese14681441
LMArena French14391415
LMArena German14181404
LMArena Japanese14061349
LMArena Korean13841361
LMArena Russian14281387
LMArena Spanish14361413

Instruction Following DeepSeek V4 Flash leads

DeepSeek V4 Flash: 74.9 (#81), Grok 4.1 Fast: 72.7 (#133)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
LMArena Instruction Following14211376

Long Context DeepSeek V4 Flash leads

DeepSeek V4 Flash: 43.8 (#85), Grok 4.1 Fast: 42.4 (#126)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
LMArena Longer Query14341390

Writing & Preference DeepSeek V4 Flash leads

DeepSeek V4 Flash: 63.8 (#61), Grok 4.1 Fast: 57.2 (#131)

BenchmarkDeepSeek V4 FlashGrok 4.1 Fast
LMArena Text14321408
LMArena Creative Writing14031394
EQ-Bench Creative Writing15591327
LMArena Multi-Turn14491389

Frequently asked questions

Is DeepSeek V4 Flash better than Grok 4.1 Fast?

DeepSeek V4 Flash is the stronger model overall, scoring 53.6 to 41.4 on the Noometry Index.

Which is cheaper, DeepSeek V4 Flash or Grok 4.1 Fast?

DeepSeek V4 Flash is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Grok 4.1 Fast lists at $0.20 and $0.50.

Is DeepSeek V4 Flash or Grok 4.1 Fast better for coding?

DeepSeek V4 Flash scores higher on coding benchmarks: 47.9 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

DeepSeek V4 Flash does, with 1M tokens against 128K.

How many benchmarks do DeepSeek V4 Flash and Grok 4.1 Fast share?

25 benchmarks have published results for both models. DeepSeek V4 Flash has 41 scored results on Noometry and Grok 4.1 Fast has 32.

Related comparisons

Go deeper