Model comparison

DeepSeek-V2 (MoE-236B, May 2024) vs gpt-oss-20b

gpt-oss-20b has enough public results to be ranked (#249); DeepSeek-V2 (MoE-236B, May 2024) does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

gpt-oss-20b OpenAI

32.1

Rank #249 Confirmed

Summary

  • They share 1 benchmark with published results for both. DeepSeek-V2 (MoE-236B, May 2024) scores higher in 1 category and gpt-oss-20b in 0 categories; one gap is clear of the uncertainty.

Side by side

DeepSeek-V2 (MoE-236B, May 2024) and gpt-oss-20b specifications
DeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
ProviderDeepSeekOpenAI
Noometry Index39.732.1
Released2024-05-072025-08-05
WeightsOpenOpen
Context window—131K
Max output—16K
Input $ / M tokens—$0.018
Output $ / M tokens—$0.09
Results tracked1034

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-V2 (MoE-236B, May 2024) leads

DeepSeek-V2 (MoE-236B, May 2024): 39.8 (#141), gpt-oss-20b: 37.1 (#185)

Coding benchmarks
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
SciCode—34.4%
WeirdML—40.9%
BigCodeBench Instruct48.9%—
LMArena Coding—1307
BigCodeBench Complete59.4%—
ALE-Bench—566.05

Agentic & Tool Use Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, gpt-oss-20b: 9.2 (#146)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
Terminal-Bench—3.4%

Reasoning Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, gpt-oss-20b: 18.8 (#251)

Reasoning benchmarks
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
Epoch Capabilities Index124.78137.81
Kagi LLM Benchmark—53.2%
CritPt—1.4%
Chess Puzzles—4%
LMArena Hard Prompts—1274
DTBench—68%
LMCA—14.5%
BIG-Bench Hard78.8%—
HellaSwag87.1%—
PIQA83.9%—
WinoGrande86.3%—

Math Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, gpt-oss-20b: 37.6 (#93)

Math benchmarks
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
OTIS Mock AIME 2024-2025—65.3%
Omni-MATH—56.5%
LMArena Math—1317

Knowledge Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, gpt-oss-20b: 34.6 (#186)

Knowledge benchmarks
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
GPQA Diamond—60.8%
MMLU-Pro—74%
GPQA (HELM)—59.4%
LMArena Expert—1258
ARC (AI2) Challenge92.2%—
MMLU78.4%—
TriviaQA80%—

Multilingual Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, gpt-oss-20b: 42.4 (#192)

Multilingual benchmarks
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
LMArena Non-English—1269
LMArena Chinese—1311
LMArena German—1249
LMArena Japanese—1245
LMArena Korean—1239
LMArena Russian—1279
LMArena Spanish—1267

Instruction Following Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, gpt-oss-20b: 62.0 (#235)

Instruction Following benchmarks
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
IFEval—73.2%
LMArena Instruction Following—1236

Long Context Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, gpt-oss-20b: 37.9 (#203)

Long Context benchmarks
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
LMArena Longer Query—1251

Writing & Preference Not comparable

DeepSeek-V2 (MoE-236B, May 2024): —, gpt-oss-20b: 35.8 (#260)

Writing & Preference benchmarks
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)gpt-oss-20b
LMArena Text—1288
LMArena Creative Writing—1201
EQ-Bench Creative Writing—666
WildBench—73.7%
LMArena Multi-Turn—1268

Frequently asked questions

Is DeepSeek-V2 (MoE-236B, May 2024) better than gpt-oss-20b?

gpt-oss-20b has enough public results to be ranked (#249); DeepSeek-V2 (MoE-236B, May 2024) does not yet, so treat this comparison as directional.

Is DeepSeek-V2 (MoE-236B, May 2024) or gpt-oss-20b better for coding?

DeepSeek-V2 (MoE-236B, May 2024) scores higher on coding benchmarks: 39.8 versus 37.1 in the Noometry coding category.

How many benchmarks do DeepSeek-V2 (MoE-236B, May 2024) and gpt-oss-20b share?

1 benchmark has published results for both models. DeepSeek-V2 (MoE-236B, May 2024) has 10 scored results on Noometry and gpt-oss-20b has 34.

Related comparisons

Go deeper