Model comparison

Deepseek Coder v2 vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 35.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Deepseek Coder v2 DeepSeek

35.9

Rank #220 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Deepseek Coder v2 scores higher in 1 category and Step 3.5 Flash in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 3.5 Flash leads 58.8 to 38.2.

Side by side

Deepseek Coder v2 and Step 3.5 Flash specifications
Deepseek Coder v2Step 3.5 Flash
ProviderDeepSeekStepFun
Noometry Index35.942.3
Released2024-06-172026-01-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked2419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.5 Flash leads

Deepseek Coder v2: 38.1 (#183), Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkDeepseek Coder v2Step 3.5 Flash
LMArena Coding12511436
BigCodeBench Instruct48.2%—
BigCodeBench Complete59.7%—
HumanEval+82.3%—
MBPP+75.1%—

Reasoning Deepseek Coder v2 leads

Deepseek Coder v2: 23.6 (#176), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkDeepseek Coder v2Step 3.5 Flash
LMArena Hard Prompts12071411
NYT Connections (extended)—28.4%
WinoGrande83.7%—

Math Step 3.5 Flash leads

Deepseek Coder v2: 34.9 (#190), Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkDeepseek Coder v2Step 3.5 Flash
LMArena Math12411408
MathArena Final-Answer Competitions—66.8%
GSM8K94.5%—

Knowledge Step 3.5 Flash leads

Deepseek Coder v2: 32.3 (#212), Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkDeepseek Coder v2Step 3.5 Flash
LMArena Expert11811421
ARC (AI2) Challenge64.3%—

Multilingual Step 3.5 Flash leads

Deepseek Coder v2: 36.3 (#240), Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkDeepseek Coder v2Step 3.5 Flash
LMArena Non-English11821385
LMArena Chinese12011447
LMArena French11851421
LMArena German11641405
LMArena Japanese11261354
LMArena Korean11041352
LMArena Russian11881385
LMArena Spanish11531419

Instruction Following Step 3.5 Flash leads

Deepseek Coder v2: 61.7 (#242), Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkDeepseek Coder v2Step 3.5 Flash
LMArena Instruction Following11801385

Long Context Step 3.5 Flash leads

Deepseek Coder v2: 37.0 (#224), Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkDeepseek Coder v2Step 3.5 Flash
LMArena Longer Query12191402

Writing & Preference Step 3.5 Flash leads

Deepseek Coder v2: 38.2 (#253), Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkDeepseek Coder v2Step 3.5 Flash
LMArena Text11911403
LMArena Creative Writing11201357
LMArena Multi-Turn11771405

Frequently asked questions

Is Deepseek Coder v2 better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 35.9 on the Noometry Index.

Is Deepseek Coder v2 or Step 3.5 Flash better for coding?

Step 3.5 Flash scores higher on coding benchmarks: 42.4 versus 38.1 in the Noometry coding category.

How many benchmarks do Deepseek Coder v2 and Step 3.5 Flash share?

17 benchmarks have published results for both models. Deepseek Coder v2 has 24 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper