Noometry

Model comparison

GPT-5 Pro vs Qwen3.8 27B

GPT-5 Pro and Qwen3.8 27B score almost the same on the Noometry Index (46.2 vs 45.3), so choose on price, context window or the category you care about most.

Last verified . 1 shared benchmarks.

GPT-5 Pro OpenAI

46.2

Rank #58 Confirmed

Qwen3.8 27B Alibaba (Qwen)

45.3

Rank #64 Confirmed

Summary

  • They share 1 benchmark with published results for both. GPT-5 Pro scores higher in 3 categories and Qwen3.8 27B in 1 category; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5 Pro leads 56.2 to 40.9.
  • Qwen3.8 27B is cheaper at $0.99 / $1.49 per million input/output tokens, against $15 / $120 for GPT-5 Pro.
  • GPT-5 Pro accepts more context: 400K tokens versus 262K.
  • Qwen3.8 27B has downloadable open weights; the other is API-only.

Side by side

GPT-5 ProQwen3.8 27B
ProviderOpenAIAlibaba (Qwen)
Noometry Index46.245.3
Released2025-10-062026-08-14
WeightsProprietaryOpen
Context window400K262K
Max output272K33K
Input $ / M tokens$15$0.99
Output $ / M tokens$120$1.49
Results tracked1228

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.8 27B leads

GPT-5 Pro: 43.4 (#77), Qwen3.8 27B: 50.3 (#42)

BenchmarkGPT-5 ProQwen3.8 27B
LMArena WebDev—1592
SciCode—46.6%
WeirdML60.4%—
LMArena Coding—1487
AlgoTune1.31—

Reasoning GPT-5 Pro leads

GPT-5 Pro: 39.2 (#52), Qwen3.8 27B: 31.5 (#71)

BenchmarkGPT-5 ProQwen3.8 27B
Epoch Capabilities Index150.26149.38
ARC-AGI-218.3%—
SimpleBench61.6%—
Kagi LLM Benchmark76.8%—
NYT Connections (extended)—54.5%
ARC-AGI-170.2%—
CritPt—5.4%
EnigmaEval18.8%—
LMArena Hard Prompts—1459
DTBench—88%
LMCA—41.4%
Surface Evolver Bench—45%

Math GPT-5 Pro leads

GPT-5 Pro: 48.0 (#53), Qwen3.8 27B: 35.7 (#139)

BenchmarkGPT-5 ProQwen3.8 27B
FrontierMath (Tiers 1-3)55.8%—
FrontierMath Tier 419.5%—
ProofBench—16%
LMArena Math—1453
FrontierMath Tier 4 (v1)14.6%—

Knowledge GPT-5 Pro leads

GPT-5 Pro: 56.2 (#39), Qwen3.8 27B: 40.9 (#105)

BenchmarkGPT-5 ProQwen3.8 27B
Humanity's Last Exam31.6%—
LMArena Expert—1482

Multimodal Not comparable

GPT-5 Pro: —, Qwen3.8 27B: 40.5 (#36)

BenchmarkGPT-5 ProQwen3.8 27B
LMArena Vision—1270

Multilingual Not comparable

GPT-5 Pro: —, Qwen3.8 27B: 54.0 (#54)

BenchmarkGPT-5 ProQwen3.8 27B
LMArena Non-English—1431
LMArena Chinese—1504
LMArena French—1468
LMArena German—1435
LMArena Japanese—1392
LMArena Korean—1389
LMArena Russian—1421
LMArena Spanish—1444

Instruction Following Not comparable

GPT-5 Pro: —, Qwen3.8 27B: 75.8 (#54)

BenchmarkGPT-5 ProQwen3.8 27B
LMArena Instruction Following—1436

Long Context Not comparable

GPT-5 Pro: —, Qwen3.8 27B: 44.3 (#66)

BenchmarkGPT-5 ProQwen3.8 27B
LMArena Longer Query—1448

Writing & Preference Not comparable

GPT-5 Pro: —, Qwen3.8 27B: 65.9 (#41)

BenchmarkGPT-5 ProQwen3.8 27B
LMArena Text—1441
LMArena Creative Writing—1382
EQ-Bench Creative Writing—1671
LMArena Multi-Turn—1443

Frequently asked questions

Is GPT-5 Pro better than Qwen3.8 27B?

GPT-5 Pro and Qwen3.8 27B score almost the same on the Noometry Index (46.2 vs 45.3), so choose on price, context window or the category you care about most.

Which is cheaper, GPT-5 Pro or Qwen3.8 27B?

Qwen3.8 27B is cheaper. It lists at $0.99 per million input tokens and $1.49 per million output tokens; GPT-5 Pro lists at $15 and $120.

Is GPT-5 Pro or Qwen3.8 27B better for coding?

Qwen3.8 27B scores higher on coding benchmarks: 50.3 versus 43.4 in the Noometry coding category.

Which has the bigger context window?

GPT-5 Pro does, with 400K tokens against 262K.

How many benchmarks do GPT-5 Pro and Qwen3.8 27B share?

1 benchmark has published results for both models. GPT-5 Pro has 12 scored results on Noometry and Qwen3.8 27B has 28.

Related comparisons

Go deeper