Model comparison

GPT-5 Pro vs Qwen Plus

GPT-5 Pro is the stronger model overall, scoring 46.2 to 36.7 on the Noometry Index. Qwen Plus costs 69× less per token, which makes it the better buy when GPT-5 Pro's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

GPT-5 Pro OpenAI

46.2

Rank #58 Confirmed

Qwen Plus Alibaba (Qwen)

36.7

Rank #204 Confirmed

Summary

  • They share 1 benchmark with published results for both. GPT-5 Pro scores higher in 4 categories and Qwen Plus in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5 Pro leads 56.2 to 27.4.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 76.8% for GPT-5 Pro and 63.3% for Qwen Plus.
  • Qwen Plus is cheaper at $0.40 / $1.20 per million input/output tokens, against $15 / $120 for GPT-5 Pro.
  • Qwen Plus accepts more context: 1M tokens versus 400K.

Side by side

GPT-5 Pro and Qwen Plus specifications
GPT-5 ProQwen Plus
ProviderOpenAIAlibaba (Qwen)
Noometry Index46.236.7
Released2025-10-062024-01-25
WeightsProprietaryProprietary
Context window400K1M
Max output272K33K
Input $ / M tokens$15$0.40
Output $ / M tokens$120$1.20
Results tracked1220

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 Pro leads

GPT-5 Pro: 43.4 (#77), Qwen Plus: 38.3 (#163)

Coding benchmarks
BenchmarkGPT-5 ProQwen Plus
WeirdML60.4%—
LMArena Coding—1328
AlgoTune1.31—

Reasoning GPT-5 Pro leads

GPT-5 Pro: 39.2 (#52), Qwen Plus: 27.6 (#101)

Reasoning benchmarks
BenchmarkGPT-5 ProQwen Plus
Kagi LLM Benchmark76.8%63.3%
ARC-AGI-218.3%—
SimpleBench61.6%—
ARC-AGI-170.2%—
EnigmaEval18.8%—
LMArena Hard Prompts—1317
DTBench—81.1%
LMCA—24%
Epoch Capabilities Index150.26—

Math GPT-5 Pro leads

GPT-5 Pro: 48.0 (#53), Qwen Plus: 22.0 (#266)

Math benchmarks
BenchmarkGPT-5 ProQwen Plus
FrontierMath (Tiers 1-3)55.8%—
FrontierMath Tier 419.5%—
OTIS Mock AIME 2024-2025—17.8%
LMArena Math—1326
MATH Level 5—65.3%
FrontierMath (Feb 2025 set)—1.7%
FrontierMath Tier 4 (v1)14.6%—

Knowledge GPT-5 Pro leads

GPT-5 Pro: 56.2 (#39), Qwen Plus: 27.4 (#245)

Knowledge benchmarks
BenchmarkGPT-5 ProQwen Plus
GPQA Diamond—48.1%
Humanity's Last Exam31.6%—
LMArena Expert—1328

Multilingual Not comparable

GPT-5 Pro: —, Qwen Plus: 45.3 (#170)

Multilingual benchmarks
BenchmarkGPT-5 ProQwen Plus
LMArena Non-English—1310
LMArena Chinese—1347
LMArena Japanese—1251
LMArena Russian—1323

Instruction Following Not comparable

GPT-5 Pro: —, Qwen Plus: 69.0 (#176)

Instruction Following benchmarks
BenchmarkGPT-5 ProQwen Plus
LMArena Instruction Following—1303

Long Context Not comparable

GPT-5 Pro: —, Qwen Plus: 40.3 (#153)

Long Context benchmarks
BenchmarkGPT-5 ProQwen Plus
LMArena Longer Query—1325

Writing & Preference Not comparable

GPT-5 Pro: —, Qwen Plus: 52.4 (#171)

Writing & Preference benchmarks
BenchmarkGPT-5 ProQwen Plus
LMArena Text—1326
LMArena Creative Writing—1293
LMArena Multi-Turn—1336

Frequently asked questions

Is GPT-5 Pro better than Qwen Plus?

GPT-5 Pro is the stronger model overall, scoring 46.2 to 36.7 on the Noometry Index. Qwen Plus costs 69× less per token, which makes it the better buy when GPT-5 Pro's lead doesn't matter for your workload.

Which is cheaper, GPT-5 Pro or Qwen Plus?

Qwen Plus is cheaper. It lists at $0.40 per million input tokens and $1.20 per million output tokens; GPT-5 Pro lists at $15 and $120.

Is GPT-5 Pro or Qwen Plus better for coding?

GPT-5 Pro scores higher on coding benchmarks: 43.4 versus 38.3 in the Noometry coding category.

Which has the bigger context window?

Qwen Plus does, with 1M tokens against 400K.

How many benchmarks do GPT-5 Pro and Qwen Plus share?

1 benchmark has published results for both models. GPT-5 Pro has 12 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper