Model comparison

GPT-5 vs Qwen2.5-Coder-32B

GPT-5 is the stronger model overall, scoring 50.9 to 33.4 on the Noometry Index. Qwen2.5-Coder-32B costs 4.6× less per token, which makes it the better buy when GPT-5's lead doesn't matter for your workload.

Last verified . 15 shared benchmarks.

GPT-5 OpenAI

50.9

Rank #45 Confirmed

Qwen2.5-Coder-32B Alibaba (Qwen)

33.4

Rank #245 Confirmed

Summary

  • They share 15 benchmarks with published results for both. GPT-5 scores higher in 8 categories and Qwen2.5-Coder-32B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in long context, where GPT-5 leads 69.5 to 38.0.
  • The biggest single-benchmark swing is Aider Polyglot: 88% for GPT-5 and 16.4% for Qwen2.5-Coder-32B.
  • Qwen2.5-Coder-32B is cheaper at $0.66 / $1 per million input/output tokens, against $1.25 / $10 for GPT-5.
  • GPT-5 accepts more context: 400K tokens versus 33K.
  • Qwen2.5-Coder-32B has downloadable open weights; the other is API-only.

Side by side

GPT-5 and Qwen2.5-Coder-32B specifications
GPT-5Qwen2.5-Coder-32B
ProviderOpenAIAlibaba (Qwen)
Noometry Index50.933.4
Released2025-08-072024-09-18
WeightsProprietaryOpen
Context window400K33K
Max output128K29K
Input $ / M tokens$1.25$0.66
Output $ / M tokens$10$1
Results tracked6931

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 leads

GPT-5: 50.3 (#47), Qwen2.5-Coder-32B: 22.6 (#333)

Coding benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
SWE-bench Verified (bash only)65%9%
Aider Polyglot88%16.4%
LMArena Coding14361276
SWE-bench Verified73.6%—
LMArena WebDev1418—
SciCode42.9%—
GSO6.9%—
WeirdML60.7%—
BigCodeBench Instruct—49%
LiveBench Coding—56.9%
BigCodeBench Complete—58%
ALE-Bench1,162—
AlgoTune1.67—
HumanEval+—87.2%
MBPP+—77%

Agentic & Tool Use Not comparable

GPT-5: 33.1 (#56), Qwen2.5-Coder-32B: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
Terminal-Bench49.6%—
GDPval34.8%—
Remote Labor Index1.7%—
DeepResearch Bench49.6%—
BALROG32.8%—
LMArena Search1133—
METR Time Horizons69.6%—

Reasoning GPT-5 leads

GPT-5: 38.3 (#64), Qwen2.5-Coder-32B: 21.2 (#225)

Reasoning benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
LMArena Hard Prompts14161251
Epoch Capabilities Index150119.49
ARC-AGI-29.9%—
SimpleBench56.7%—
Kagi LLM Benchmark72.7%—
ARC-AGI-165.7%—
CritPt12.6%—
Chess Puzzles37%—
EnigmaEval10.5%—
EBR-Bench12.7%—
LiveBench Reasoning—42.1%
Mystery Game Puzzles23%—
DTBench90.7%—
LiveBench Data Analysis—49.9%
LMCA40%—
ForecastBench61.4—
HellaSwag—83%
LiveBench—46.2%
WinoGrande—80.8%

Math GPT-5 leads

GPT-5: 55.0 (#44), Qwen2.5-Coder-32B: 33.3 (#204)

Math benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
LMArena Math14071251
FrontierMath (Tiers 1-3)55.4%—
FrontierMath Tier 422%—
OTIS Mock AIME 2024-202591.4%—
ProofBench18%—
Omni-MATH64.7%—
LiveBench Math—46.6%
MATH Level 598.1%—
FrontierMath (Feb 2025 set)32.4%—
FrontierMath Tier 4 (v1)12.5%—
GSM8K—93%

Knowledge GPT-5 leads

GPT-5: 56.6 (#43), Qwen2.5-Coder-32B: 33.4 (#203)

Knowledge benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
LMArena Expert14191221
GPQA Diamond86.2%—
Humanity's Last Exam25.3%—
SimpleQA Verified50.1%—
MMLU-Pro86.3%—
Confabulations10.3%—
Vectara Hallucination Rate14.7%—
GPQA (HELM)79.2%—
ARC (AI2) Challenge—70.5%
MMLU—79.1%

Multimodal Not comparable

GPT-5: 46.8 (#13), Qwen2.5-Coder-32B: —

Multimodal benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
LMArena Vision1232—
GeoBench81%—
VPCT66%—

Multilingual GPT-5 leads

GPT-5: 51.4 (#110), Qwen2.5-Coder-32B: 37.8 (#235)

Multilingual benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
LMArena Non-English13971205
LMArena Chinese14221222
LMArena Russian14061228
LMArena French1410—
LMArena German1416—
LMArena Japanese1409—
LMArena Korean1360—
LMArena Spanish1399—

Instruction Following GPT-5 leads

GPT-5: 73.8 (#113), Qwen2.5-Coder-32B: 61.4 (#245)

Instruction Following benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
LMArena Instruction Following13881223
LiveBench Instruction Following—58.7%
IFEval87.5%—

Long Context GPT-5 leads

GPT-5: 69.5 (#2), Qwen2.5-Coder-32B: 38.0 (#208)

Long Context benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
LMArena Longer Query13991251
Fiction.LiveBench97.2%—

Writing & Preference GPT-5 leads

GPT-5: 63.4 (#65), Qwen2.5-Coder-32B: 41.6 (#240)

Writing & Preference benchmarks
BenchmarkGPT-5Qwen2.5-Coder-32B
LMArena Text14061230
LMArena Creative Writing13651174
LMArena Multi-Turn14261222
Short-Story Creative Writing86%—
EQ-Bench Creative Writing1627—
WildBench85.7%—
LiveBench Language—23.3%

Frequently asked questions

Is GPT-5 better than Qwen2.5-Coder-32B?

GPT-5 is the stronger model overall, scoring 50.9 to 33.4 on the Noometry Index. Qwen2.5-Coder-32B costs 4.6× less per token, which makes it the better buy when GPT-5's lead doesn't matter for your workload.

Which is cheaper, GPT-5 or Qwen2.5-Coder-32B?

Qwen2.5-Coder-32B is cheaper. It lists at $0.66 per million input tokens and $1 per million output tokens; GPT-5 lists at $1.25 and $10.

Is GPT-5 or Qwen2.5-Coder-32B better for coding?

GPT-5 scores higher on coding benchmarks: 50.3 versus 22.6 in the Noometry coding category.

Which has the bigger context window?

GPT-5 does, with 400K tokens against 33K.

How many benchmarks do GPT-5 and Qwen2.5-Coder-32B share?

15 benchmarks have published results for both models. GPT-5 has 69 scored results on Noometry and Qwen2.5-Coder-32B has 31.

Related comparisons

Go deeper