Model comparison

DeepSeek LLM 67B vs DeepSeek V4.1 Flash

DeepSeek V4.1 Flash is the stronger model overall, scoring 52.8 to 24.9 on the Noometry Index.

Last verified . 13 shared benchmarks.

DeepSeek LLM 67B DeepSeek

24.9

Rank #347 Confirmed

DeepSeek V4.1 Flash DeepSeek

52.8

Rank #38 Confirmed

Summary

  • They share 13 benchmarks with published results for both. DeepSeek LLM 67B scores higher in 0 categories and DeepSeek V4.1 Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where DeepSeek V4.1 Flash leads 66.7 to 8.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 0.8% for DeepSeek LLM 67B and 98.3% for DeepSeek V4.1 Flash.

Side by side

DeepSeek LLM 67B and DeepSeek V4.1 Flash specifications
DeepSeek LLM 67BDeepSeek V4.1 Flash
ProviderDeepSeekDeepSeek
Noometry Index24.952.8
Released2023-11-292026-09-09
WeightsOpenOpen
Context window—1M
Max output—393K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked1537

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek V4.1 Flash leads

DeepSeek LLM 67B: 31.9 (#278), DeepSeek V4.1 Flash: 52.9 (#32)

Coding benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
LMArena Coding10961506
LMArena WebDev—1619
SciCode—51.9%
ALE-Bench—1,092

Agentic & Tool Use Not comparable

DeepSeek LLM 67B: —, DeepSeek V4.1 Flash: 31.2 (#69)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
APEX-Agents—39.5%
GDP.pdf—19.8%

Reasoning DeepSeek V4.1 Flash leads

DeepSeek LLM 67B: 16.5 (#304), DeepSeek V4.1 Flash: 50.2 (#36)

Reasoning benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
LMArena Hard Prompts10701483
Epoch Capabilities Index110.5154.9
NYT Connections (extended)—89.6%
CritPt—14.3%
Chess Puzzles0%—
Mystery Game Puzzles—43%
DTBench—89.9%
LMCA—47%
Surface Evolver Bench—46.3%

Math DeepSeek V4.1 Flash leads

DeepSeek LLM 67B: 8.7 (#324), DeepSeek V4.1 Flash: 66.7 (#25)

Math benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
OTIS Mock AIME 2024-20250.8%98.3%
LMArena Math11081477
FrontierMath (Tiers 1-3)—67.4%
FrontierMath Tier 4—26.8%
ProofBench—54%
MATH Level 56.4%—

Knowledge DeepSeek V4.1 Flash leads

DeepSeek LLM 67B: 7.0 (#313), DeepSeek V4.1 Flash: 57.9 (#38)

Knowledge benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
GPQA Diamond24.6%89.8%
LMArena Expert—1506

Multimodal Not comparable

DeepSeek LLM 67B: —, DeepSeek V4.1 Flash: 39.1 (#61)

Multimodal benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
LMArena Vision—1277
Furniture Assembly—34.2%

Multilingual DeepSeek V4.1 Flash leads

DeepSeek LLM 67B: 29.4 (#267), DeepSeek V4.1 Flash: 55.0 (#35)

Multilingual benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
LMArena Non-English10731448
LMArena Chinese11321497
LMArena French—1452
LMArena German—1484
LMArena Japanese—1412
LMArena Korean—1452
LMArena Russian—1471
LMArena Spanish—1459

Instruction Following DeepSeek V4.1 Flash leads

DeepSeek LLM 67B: 55.4 (#277), DeepSeek V4.1 Flash: 77.3 (#26)

Instruction Following benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
LMArena Instruction Following10791474

Long Context DeepSeek V4.1 Flash leads

DeepSeek LLM 67B: 33.1 (#265), DeepSeek V4.1 Flash: 45.2 (#47)

Long Context benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
LMArena Longer Query10921475

Writing & Preference DeepSeek V4.1 Flash leads

DeepSeek LLM 67B: 31.6 (#282), DeepSeek V4.1 Flash: 65.4 (#48)

Writing & Preference benchmarks
BenchmarkDeepSeek LLM 67BDeepSeek V4.1 Flash
LMArena Text11051462
LMArena Creative Writing10671435
LMArena Multi-Turn10821457
EQ-Bench Creative Writing—1540

Frequently asked questions

Is DeepSeek LLM 67B better than DeepSeek V4.1 Flash?

DeepSeek V4.1 Flash is the stronger model overall, scoring 52.8 to 24.9 on the Noometry Index.

Is DeepSeek LLM 67B or DeepSeek V4.1 Flash better for coding?

DeepSeek V4.1 Flash scores higher on coding benchmarks: 52.9 versus 31.9 in the Noometry coding category.

How many benchmarks do DeepSeek LLM 67B and DeepSeek V4.1 Flash share?

13 benchmarks have published results for both models. DeepSeek LLM 67B has 15 scored results on Noometry and DeepSeek V4.1 Flash has 37.

Related comparisons

Go deeper