Model comparison

Deepseek Coder v2 vs gpt-oss-120b

Deepseek Coder v2 and gpt-oss-120b score almost the same on the Noometry Index (35.9 vs 36.3), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

Deepseek Coder v2 DeepSeek

35.9

Rank #220 Confirmed

gpt-oss-120b OpenAI

36.3

Rank #217 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Deepseek Coder v2 scores higher in 3 categories and gpt-oss-120b in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where gpt-oss-120b leads 52.5 to 34.9.

Side by side

Deepseek Coder v2 and gpt-oss-120b specifications
Deepseek Coder v2gpt-oss-120b
ProviderDeepSeekOpenAI
Noometry Index35.936.3
Released2024-06-172025-08-05
WeightsOpenOpen
Context window—131K
Max output—41K
Input $ / M tokens—$0.037
Output $ / M tokens—$0.17
Results tracked2448

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Deepseek Coder v2 leads

Deepseek Coder v2: 38.1 (#183), gpt-oss-120b: 33.5 (#256)

Coding benchmarks
BenchmarkDeepseek Coder v2gpt-oss-120b
LMArena Coding12511380
SWE-bench Verified (bash only)—26%
Aider Polyglot—41.8%
SciCode—36%
WeirdML—48.2%
BigCodeBench Instruct48.2%—
BigCodeBench Complete59.7%—
ALE-Bench—575.62
AlgoTune—1.41
HumanEval+82.3%—
MBPP+75.1%—

Agentic & Tool Use Not comparable

Deepseek Coder v2: —, gpt-oss-120b: 12.2 (#153)

Agentic & Tool Use benchmarks
BenchmarkDeepseek Coder v2gpt-oss-120b
Terminal-Bench—18.7%
APEX-Agents—4.4%
METR Time Horizons—56.6%
Vending-Bench 2—-21.53

Reasoning Deepseek Coder v2 leads

Deepseek Coder v2: 23.6 (#176), gpt-oss-120b: 20.0 (#245)

Reasoning benchmarks
BenchmarkDeepseek Coder v2gpt-oss-120b
LMArena Hard Prompts12071364
SimpleBench—22.1%
Kagi LLM Benchmark—58.6%
CritPt—1.1%
Chess Puzzles—20%
Mystery Game Puzzles—2%
DTBench—76.3%
LMCA—22.1%
Surface Evolver Bench—25%
Epoch Capabilities Index—139.93
WinoGrande83.7%—

Math gpt-oss-120b leads

Deepseek Coder v2: 34.9 (#190), gpt-oss-120b: 52.5 (#50)

Math benchmarks
BenchmarkDeepseek Coder v2gpt-oss-120b
LMArena Math12411389
OTIS Mock AIME 2024-2025—88.9%
Omni-MATH—68.8%
GSM8K94.5%—

Knowledge gpt-oss-120b leads

Deepseek Coder v2: 32.3 (#212), gpt-oss-120b: 42.4 (#96)

Knowledge benchmarks
BenchmarkDeepseek Coder v2gpt-oss-120b
LMArena Expert11811356
GPQA Diamond—75.8%
MMLU-Pro—79.5%
Confabulations—15.7%
Vectara Hallucination Rate—14.2%
GPQA (HELM)—68.4%
ARC (AI2) Challenge64.3%—

Multilingual gpt-oss-120b leads

Deepseek Coder v2: 36.3 (#240), gpt-oss-120b: 48.0 (#147)

Multilingual benchmarks
BenchmarkDeepseek Coder v2gpt-oss-120b
LMArena Non-English11821351
LMArena Chinese12011385
LMArena French11851369
LMArena German11641353
LMArena Japanese11261331
LMArena Korean11041282
LMArena Russian11881343
LMArena Spanish11531389

Instruction Following gpt-oss-120b leads

Deepseek Coder v2: 61.7 (#242), gpt-oss-120b: 69.3 (#173)

Instruction Following benchmarks
BenchmarkDeepseek Coder v2gpt-oss-120b
LMArena Instruction Following11801318
IFEval—83.6%

Long Context Deepseek Coder v2 leads

Deepseek Coder v2: 37.0 (#224), gpt-oss-120b: 31.4 (#278)

Long Context benchmarks
BenchmarkDeepseek Coder v2gpt-oss-120b
LMArena Longer Query12191319
Fiction.LiveBench—44.4%

Writing & Preference gpt-oss-120b leads

Deepseek Coder v2: 38.2 (#253), gpt-oss-120b: 46.5 (#217)

Writing & Preference benchmarks
BenchmarkDeepseek Coder v2gpt-oss-120b
LMArena Text11911365
LMArena Creative Writing11201275
LMArena Multi-Turn11771340
Short-Story Creative Writing—77.1%
EQ-Bench Creative Writing—961
WildBench—84.5%

Frequently asked questions

Is Deepseek Coder v2 better than gpt-oss-120b?

Deepseek Coder v2 and gpt-oss-120b score almost the same on the Noometry Index (35.9 vs 36.3), so choose on price, context window or the category you care about most.

Is Deepseek Coder v2 or gpt-oss-120b better for coding?

Deepseek Coder v2 scores higher on coding benchmarks: 38.1 versus 33.5 in the Noometry coding category.

How many benchmarks do Deepseek Coder v2 and gpt-oss-120b share?

17 benchmarks have published results for both models. Deepseek Coder v2 has 24 scored results on Noometry and gpt-oss-120b has 48.

Related comparisons

Go deeper