Noometry

Model comparison

DeepSeek LLM 67B vs DeepSeek V4 Flash

DeepSeek V4 Flash is the stronger model overall, scoring 53.6 to 24.9 on the Noometry Index.

Last verified . 14 shared benchmarks.

DeepSeek LLM 67B DeepSeek

24.9

Rank #347 Confirmed

DeepSeek V4 Flash DeepSeek

53.6

Rank #35 Confirmed

Summary

  • They share 14 benchmarks with published results for both. DeepSeek LLM 67B scores higher in 0 categories and DeepSeek V4 Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek V4 Flash leads 60.3 to 8.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 0.8% for DeepSeek LLM 67B and 94.4% for DeepSeek V4 Flash.

Side by side

DeepSeek LLM 67BDeepSeek V4 Flash
ProviderDeepSeekDeepSeek
Noometry Index24.953.6
Released2023-11-292026-04-24
WeightsOpenOpen
Context window—1M
Max output—393K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked1541

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4 Flash leads

DeepSeek LLM 67B: 31.9 (#278), DeepSeek V4 Flash: 47.9 (#59)

BenchmarkDeepSeek LLM 67BDeepSeek V4 Flash
LMArena Coding10961457
FrontierCode—18.8%
LMArena WebDev—1582
SciCode—49.9%
WeirdML—63%
ALE-Bench—1,306

Reasoning DeepSeek V4 Flash leads

DeepSeek LLM 67B: 16.5 (#304), DeepSeek V4 Flash: 53.7 (#30)

BenchmarkDeepSeek LLM 67BDeepSeek V4 Flash
Chess Puzzles0%33%
LMArena Hard Prompts10701444
Epoch Capabilities Index110.5154.49
ARC-AGI-2—61.4%
SimpleBench—61.1%
Kagi LLM Benchmark—52.2%
NYT Connections (extended)—89.6%
ARC-AGI-1—89%
CritPt—16.6%
Mystery Game Puzzles—34%
DTBench—90.9%
LMCA—41.7%

Math DeepSeek V4 Flash leads

DeepSeek LLM 67B: 8.7 (#324), DeepSeek V4 Flash: 60.3 (#37)

BenchmarkDeepSeek LLM 67BDeepSeek V4 Flash
OTIS Mock AIME 2024-20250.8%94.4%
LMArena Math11081427
FrontierMath (Tiers 1-3)—57.5%
FrontierMath Tier 4—24.4%
MathArena Final-Answer Competitions—76.5%
ProofBench—56%
MATH Level 56.4%—

Knowledge DeepSeek V4 Flash leads

DeepSeek LLM 67B: 7.0 (#313), DeepSeek V4 Flash: 55.4 (#48)

BenchmarkDeepSeek LLM 67BDeepSeek V4 Flash
GPQA Diamond24.6%91%
SimpleQA Verified—33.6%
LMArena Expert—1441

Multilingual DeepSeek V4 Flash leads

DeepSeek LLM 67B: 29.4 (#267), DeepSeek V4 Flash: 53.0 (#72)

BenchmarkDeepSeek LLM 67BDeepSeek V4 Flash
LMArena Non-English10731420
LMArena Chinese11321468
LMArena French—1439
LMArena German—1418
LMArena Japanese—1406
LMArena Korean—1384
LMArena Russian—1428
LMArena Spanish—1436

Instruction Following DeepSeek V4 Flash leads

DeepSeek LLM 67B: 55.4 (#277), DeepSeek V4 Flash: 74.9 (#81)

BenchmarkDeepSeek LLM 67BDeepSeek V4 Flash
LMArena Instruction Following10791421

Long Context DeepSeek V4 Flash leads

DeepSeek LLM 67B: 33.1 (#265), DeepSeek V4 Flash: 43.8 (#85)

BenchmarkDeepSeek LLM 67BDeepSeek V4 Flash
LMArena Longer Query10921434

Writing & Preference DeepSeek V4 Flash leads

DeepSeek LLM 67B: 31.6 (#282), DeepSeek V4 Flash: 63.8 (#61)

BenchmarkDeepSeek LLM 67BDeepSeek V4 Flash
LMArena Text11051432
LMArena Creative Writing10671403
LMArena Multi-Turn10821449
EQ-Bench Creative Writing—1559

Frequently asked questions

Is DeepSeek LLM 67B better than DeepSeek V4 Flash?

DeepSeek V4 Flash is the stronger model overall, scoring 53.6 to 24.9 on the Noometry Index.

Is DeepSeek LLM 67B or DeepSeek V4 Flash better for coding?

DeepSeek V4 Flash scores higher on coding benchmarks: 47.9 versus 31.9 in the Noometry coding category.

How many benchmarks do DeepSeek LLM 67B and DeepSeek V4 Flash share?

14 benchmarks have published results for both models. DeepSeek LLM 67B has 15 scored results on Noometry and DeepSeek V4 Flash has 41.

Related comparisons

Go deeper