Model comparison

DeepSeek-V3.1 vs gpt-oss-120b

DeepSeek-V3.1 is the stronger model overall, scoring 42.2 to 36.0 on the Noometry Index. gpt-oss-120b costs 6.0× less per token, which makes it the better buy when DeepSeek-V3.1's lead doesn't matter for your workload.

Last verified . 26 shared benchmarks.

DeepSeek-V3.1 DeepSeek

42.2

Rank #106 Confirmed

gpt-oss-120b OpenAI

36.0

Rank #210 Confirmed

Summary

  • They share 26 benchmarks with published results for both. DeepSeek-V3.1 scores higher in 7 categories and gpt-oss-120b in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where gpt-oss-120b leads 50.6 to 36.1.
  • The biggest single-benchmark swing is SimpleBench: 40% for DeepSeek-V3.1 and 22.1% for gpt-oss-120b.
  • gpt-oss-120b is cheaper at $0.037 / $0.17 per million input/output tokens, against $0.25 / $0.95 for DeepSeek-V3.1.
  • DeepSeek-V3.1 accepts more context: 164K tokens versus 131K.

Side by side

DeepSeek-V3.1 and gpt-oss-120b specifications
DeepSeek-V3.1gpt-oss-120b
ProviderDeepSeekOpenAI
Noometry Index42.236.0
Released2025-08-212025-08-05
WeightsOpenOpen
Context window164K131K
Max output8K41K
Input $ / M tokens$0.25$0.037
Output $ / M tokens$0.95$0.17
Results tracked2748

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-V3.1 leads

DeepSeek-V3.1: 39.8 (#140), gpt-oss-120b: 33.2 (#251)

Coding benchmarks
BenchmarkDeepSeek-V3.1gpt-oss-120b
WeirdML38.4%48.2%
LMArena Coding14171380
SWE-bench Verified (bash only)—26%
Aider Polyglot—41.8%
SciCode—36%
ALE-Bench—575.62
AlgoTune—1.41

Agentic & Tool Use Not comparable

DeepSeek-V3.1: —, gpt-oss-120b: 12.1 (#145)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V3.1gpt-oss-120b
Terminal-Bench—18.7%
APEX-Agents—4.4%
METR Time Horizons—56.6%
Vending-Bench 2—-21.53

Reasoning DeepSeek-V3.1 leads

DeepSeek-V3.1: 27.3 (#109), gpt-oss-120b: 19.5 (#236)

Reasoning benchmarks
BenchmarkDeepSeek-V3.1gpt-oss-120b
SimpleBench40%22.1%
Kagi LLM Benchmark53.2%58.6%
LMArena Hard Prompts14171364
DTBench82.7%76.3%
LMCA24.3%22.1%
Epoch Capabilities Index139.92139.94
CritPt—1.1%
Chess Puzzles—20%
Mystery Game Puzzles—2%
Surface Evolver Bench—25%
ForecastBench58—

Math gpt-oss-120b leads

DeepSeek-V3.1: 36.1 (#125), gpt-oss-120b: 50.6 (#43)

Math benchmarks
BenchmarkDeepSeek-V3.1gpt-oss-120b
LMArena Math14201388
OTIS Mock AIME 2024-2025—88.9%
Omni-MATH—68.8%

Knowledge Too close to call

DeepSeek-V3.1: 43.0 (#86), gpt-oss-120b: 42.3 (#89)

Knowledge benchmarks
BenchmarkDeepSeek-V3.1gpt-oss-120b
Vectara Hallucination Rate5.5%14.2%
LMArena Expert14031356
GPQA Diamond—75.8%
MMLU-Pro—79.5%
Confabulations—15.7%
GPQA (HELM)—68.4%

Multilingual DeepSeek-V3.1 leads

DeepSeek-V3.1: 51.8 (#100), gpt-oss-120b: 48.2 (#142)

Multilingual benchmarks
BenchmarkDeepSeek-V3.1gpt-oss-120b
LMArena Non-English14001350
LMArena Chinese14701384
LMArena French14471370
LMArena German14121355
LMArena Japanese13741332
LMArena Korean13371283
LMArena Russian14051343
LMArena Spanish14291388

Instruction Following DeepSeek-V3.1 leads

DeepSeek-V3.1: 74.1 (#105), gpt-oss-120b: 69.5 (#168)

Instruction Following benchmarks
BenchmarkDeepSeek-V3.1gpt-oss-120b
LMArena Instruction Following14001318
IFEval—83.6%

Long Context DeepSeek-V3.1 leads

DeepSeek-V3.1: 36.3 (#227), gpt-oss-120b: 31.4 (#273)

Long Context benchmarks
BenchmarkDeepSeek-V3.1gpt-oss-120b
Fiction.LiveBench52.8%44.4%
LMArena Longer Query14221319

Writing & Preference DeepSeek-V3.1 leads

DeepSeek-V3.1: 60.5 (#93), gpt-oss-120b: 46.7 (#213)

Writing & Preference benchmarks
BenchmarkDeepSeek-V3.1gpt-oss-120b
LMArena Text14201366
LMArena Creative Writing14011274
EQ-Bench Creative Writing1436961
LMArena Multi-Turn14081340
Short-Story Creative Writing—77.1%
WildBench—84.5%

Frequently asked questions

Is DeepSeek-V3.1 better than gpt-oss-120b?

DeepSeek-V3.1 is the stronger model overall, scoring 42.2 to 36.0 on the Noometry Index. gpt-oss-120b costs 6.0× less per token, which makes it the better buy when DeepSeek-V3.1's lead doesn't matter for your workload.

Which is cheaper, DeepSeek-V3.1 or gpt-oss-120b?

gpt-oss-120b is cheaper. It lists at $0.037 per million input tokens and $0.17 per million output tokens; DeepSeek-V3.1 lists at $0.25 and $0.95.

Is DeepSeek-V3.1 or gpt-oss-120b better for coding?

DeepSeek-V3.1 scores higher on coding benchmarks: 39.8 versus 33.2 in the Noometry coding category.

Which has the bigger context window?

DeepSeek-V3.1 does, with 164K tokens against 131K.

How many benchmarks do DeepSeek-V3.1 and gpt-oss-120b share?

26 benchmarks have published results for both models. DeepSeek-V3.1 has 27 scored results on Noometry and gpt-oss-120b has 48.

Related comparisons

Go deeper