Model comparison

o1-pro vs Qwen2.5 14B Instruct

o1-pro has enough public results to be ranked (#271); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

o1-pro OpenAI

31.5

Rank #271 Reported

Summary

  • Qwen2.5 14B Instruct is cheaper at $0.35 / $1.40 per million input/output tokens, against $150 / $600 for o1-pro.
  • o1-pro accepts more context: 200K tokens versus 131K.
  • Qwen2.5 14B Instruct has downloadable open weights; the other is API-only.

Side by side

o1-pro and Qwen2.5 14B Instruct specifications
o1-proQwen2.5 14B Instruct
ProviderOpenAIAlibaba (Qwen)
Noometry Index31.538.7
Released2025-03-192024-09
WeightsProprietaryOpen
Context window200K131K
Max output100K8K
Input $ / M tokens$150$0.35
Output $ / M tokens$600$1.40
Results tracked33

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

o1-pro: —, Qwen2.5 14B Instruct: 37.7 (#191)

Coding benchmarks
Benchmarko1-proQwen2.5 14B Instruct
BigCodeBench Instruct—39.8%
BigCodeBench Complete—52.2%

Reasoning Not comparable

o1-pro: 20.4 (#239), Qwen2.5 14B Instruct: —

Reasoning benchmarks
Benchmarko1-proQwen2.5 14B Instruct
ARC-AGI-123.3%—
EnigmaEval6.1%—

Knowledge Not comparable

o1-pro: 29.7 (#234), Qwen2.5 14B Instruct: —

Knowledge benchmarks
Benchmarko1-proQwen2.5 14B Instruct
Humanity's Last Exam8.1%—
MMLU—79.9%

Frequently asked questions

Is o1-pro better than Qwen2.5 14B Instruct?

o1-pro has enough public results to be ranked (#271); Qwen2.5 14B Instruct does not yet, so treat this comparison as directional.

Which is cheaper, o1-pro or Qwen2.5 14B Instruct?

Qwen2.5 14B Instruct is cheaper. It lists at $0.35 per million input tokens and $1.40 per million output tokens; o1-pro lists at $150 and $600.

Which has the bigger context window?

o1-pro does, with 200K tokens against 131K.

How many benchmarks do o1-pro and Qwen2.5 14B Instruct share?

0 benchmarks have published results for both models. o1-pro has 3 scored results on Noometry and Qwen2.5 14B Instruct has 3.

Related comparisons

Go deeper