Model comparison

gpt-oss-20b vs Qwen3 14B

Qwen3 14B is the stronger model overall, scoring 35.5 to 32.5 on the Noometry Index. gpt-oss-20b costs 17× less per token, which makes it the better buy when Qwen3 14B's lead doesn't matter for your workload.

Last verified . 9 shared benchmarks.

gpt-oss-20b OpenAI

32.5

Rank #255 Confirmed

Qwen3 14B Alibaba (Qwen)

35.5

Rank #225 Confirmed

Summary

  • They share 9 benchmarks with published results for both. gpt-oss-20b scores higher in 3 categories and Qwen3 14B in 3 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in agentic & tool use, where Qwen3 14B leads 29.6 to 9.3.
  • gpt-oss-20b is cheaper at $0.018 / $0.09 per million input/output tokens, against $0.35 / $1.40 for Qwen3 14B.

Side by side

gpt-oss-20b and Qwen3 14B specifications
gpt-oss-20bQwen3 14B
ProviderOpenAIAlibaba (Qwen)
Noometry Index32.535.5
Released2025-08-052025-04
WeightsOpenOpen
Context window131K131K
Max output16K8K
Input $ / M tokens$0.018$0.35
Output $ / M tokens$0.09$1.40
Results tracked3412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

gpt-oss-20b: 37.6 (#192), Qwen3 14B: 37.3 (#195)

Coding benchmarks
Benchmarkgpt-oss-20bQwen3 14B
SciCode34.4%31.6%
WeirdML40.9%—
LMArena Coding1306—
ALE-Bench566.05—

Agentic & Tool Use Qwen3 14B leads

gpt-oss-20b: 9.3 (#154), Qwen3 14B: 29.6 (#83)

Agentic & Tool Use benchmarks
Benchmarkgpt-oss-20bQwen3 14B
Terminal-Bench3.4%—
Berkeley Function Calling Leaderboard—41%

Reasoning Too close to call

gpt-oss-20b: 19.3 (#261), Qwen3 14B: 18.5 (#280)

Reasoning benchmarks
Benchmarkgpt-oss-20bQwen3 14B
Kagi LLM Benchmark53.2%49.1%
CritPt1.4%0%
Chess Puzzles4%4%
DTBench68%64%
LMCA14.5%18.2%
Epoch Capabilities Index137.82138.23
LMArena Hard Prompts1274—

Math Too close to call

gpt-oss-20b: 39.4 (#103), Qwen3 14B: 38.6 (#133)

Math benchmarks
Benchmarkgpt-oss-20bQwen3 14B
OTIS Mock AIME 2024-202565.3%66.4%
Omni-MATH56.5%—
LMArena Math1317—

Knowledge Qwen3 14B leads

gpt-oss-20b: 34.6 (#195), Qwen3 14B: 39.3 (#134)

Knowledge benchmarks
Benchmarkgpt-oss-20bQwen3 14B
GPQA Diamond60.8%63.8%
MMLU-Pro74%—
Vectara Hallucination Rate—5.4%
GPQA (HELM)59.4%—
LMArena Expert1258—

Multilingual Not comparable

gpt-oss-20b: 42.2 (#197), Qwen3 14B: —

Multilingual benchmarks
Benchmarkgpt-oss-20bQwen3 14B
LMArena Non-English1268—
LMArena Chinese1314—
LMArena German1255—
LMArena Japanese1244—
LMArena Korean1236—
LMArena Russian1278—
LMArena Spanish1267—

Instruction Following Not comparable

gpt-oss-20b: 61.8 (#240), Qwen3 14B: —

Instruction Following benchmarks
Benchmarkgpt-oss-20bQwen3 14B
IFEval73.2%—
LMArena Instruction Following1236—

Long Context Too close to call

gpt-oss-20b: 37.9 (#209), Qwen3 14B: 38.1 (#204)

Long Context benchmarks
Benchmarkgpt-oss-20bQwen3 14B
Fiction.LiveBench—62.5%
LMArena Longer Query1250—

Writing & Preference Not comparable

gpt-oss-20b: 35.5 (#265), Qwen3 14B: —

Writing & Preference benchmarks
Benchmarkgpt-oss-20bQwen3 14B
LMArena Text1287—
LMArena Creative Writing1201—
EQ-Bench Creative Writing666—
WildBench73.7%—
LMArena Multi-Turn1268—

Frequently asked questions

Is gpt-oss-20b better than Qwen3 14B?

Qwen3 14B is the stronger model overall, scoring 35.5 to 32.5 on the Noometry Index. gpt-oss-20b costs 17× less per token, which makes it the better buy when Qwen3 14B's lead doesn't matter for your workload.

Which is cheaper, gpt-oss-20b or Qwen3 14B?

gpt-oss-20b is cheaper. It lists at $0.018 per million input tokens and $0.09 per million output tokens; Qwen3 14B lists at $0.35 and $1.40.

Is gpt-oss-20b or Qwen3 14B better for coding?

They score almost the same on coding (37.6 vs 37.3); test both on your own repository before choosing.

Which has the bigger context window?

Both accept 131K tokens.

How many benchmarks do gpt-oss-20b and Qwen3 14B share?

9 benchmarks have published results for both models. gpt-oss-20b has 34 scored results on Noometry and Qwen3 14B has 12.

Related comparisons

Go deeper