Model comparison

o1-pro vs Qwen Plus

Qwen Plus is the stronger model overall, scoring 37.1 to 31.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

o1-pro OpenAI

31.5

Rank #271 Reported

Qwen Plus Alibaba (Qwen)

37.1

Rank #210 Confirmed

Summary

  • The widest gap is in reasoning, where Qwen Plus leads 28.4 to 20.4.
  • Qwen Plus is cheaper at $0.40 / $1.20 per million input/output tokens, against $150 / $600 for o1-pro.
  • Qwen Plus accepts more context: 1M tokens versus 200K.

Side by side

o1-pro and Qwen Plus specifications
o1-proQwen Plus
ProviderOpenAIAlibaba (Qwen)
Noometry Index31.537.1
Released2025-03-192024-01-25
WeightsProprietaryProprietary
Context window200K1M
Max output100K33K
Input $ / M tokens$150$0.40
Output $ / M tokens$600$1.20
Results tracked320

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

o1-pro: —, Qwen Plus: 38.9 (#167)

Coding benchmarks
Benchmarko1-proQwen Plus
LMArena Coding—1328

Reasoning Qwen Plus leads

o1-pro: 20.4 (#239), Qwen Plus: 28.4 (#107)

Reasoning benchmarks
Benchmarko1-proQwen Plus
Kagi LLM Benchmark—63.3%
ARC-AGI-123.3%—
EnigmaEval6.1%—
LMArena Hard Prompts—1317
DTBench—81.1%
LMCA—24%

Math Not comparable

o1-pro: —, Qwen Plus: 23.3 (#271)

Math benchmarks
Benchmarko1-proQwen Plus
OTIS Mock AIME 2024-2025—17.8%
LMArena Math—1326
MATH Level 5—65.3%
FrontierMath (Feb 2025 set)—1.7%

Knowledge o1-pro leads

o1-pro: 29.7 (#234), Qwen Plus: 27.4 (#251)

Knowledge benchmarks
Benchmarko1-proQwen Plus
GPQA Diamond—48.1%
Humanity's Last Exam8.1%—
LMArena Expert—1328

Multilingual Not comparable

o1-pro: —, Qwen Plus: 45.1 (#175)

Multilingual benchmarks
Benchmarko1-proQwen Plus
LMArena Non-English—1310
LMArena Chinese—1347
LMArena Japanese—1251
LMArena Russian—1323

Instruction Following Not comparable

o1-pro: —, Qwen Plus: 68.8 (#181)

Instruction Following benchmarks
Benchmarko1-proQwen Plus
LMArena Instruction Following—1303

Long Context Not comparable

o1-pro: —, Qwen Plus: 40.3 (#158)

Long Context benchmarks
Benchmarko1-proQwen Plus
LMArena Longer Query—1324

Writing & Preference Not comparable

o1-pro: —, Qwen Plus: 52.2 (#176)

Writing & Preference benchmarks
Benchmarko1-proQwen Plus
LMArena Text—1326
LMArena Creative Writing—1293
LMArena Multi-Turn—1336

Frequently asked questions

Is o1-pro better than Qwen Plus?

Qwen Plus is the stronger model overall, scoring 37.1 to 31.5 on the Noometry Index.

Which is cheaper, o1-pro or Qwen Plus?

Qwen Plus is cheaper. It lists at $0.40 per million input tokens and $1.20 per million output tokens; o1-pro lists at $150 and $600.

Which has the bigger context window?

Qwen Plus does, with 1M tokens against 200K.

How many benchmarks do o1-pro and Qwen Plus share?

0 benchmarks have published results for both models. o1-pro has 3 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper