Noometry

Model comparison

o3-mini vs Qwen Max

o3-mini is the stronger model overall, scoring 36.7 to 34.7 on the Noometry Index.

Last verified . 23 shared benchmarks.

o3-mini OpenAI

36.7

Rank #212 Confirmed

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Summary

  • They share 23 benchmarks with published results for both. o3-mini scores higher in 6 categories and Qwen Max in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where o3-mini leads 40.8 to 30.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 76.9% for o3-mini and 16.1% for Qwen Max.
  • o3-mini is cheaper at $1.10 / $4.40 per million input/output tokens, against $1.60 / $6.40 for Qwen Max.
  • o3-mini accepts more context: 200K tokens versus 33K.

Side by side

o3-miniQwen Max
ProviderOpenAIAlibaba (Qwen)
Noometry Index36.734.7
Released2024-12-202024-04-03
WeightsProprietaryProprietary
Context window200K33K
Max output100K8K
Input $ / M tokens$1.10$1.60
Output $ / M tokens$4.40$6.40
Results tracked5123

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3-mini leads

o3-mini: 40.8 (#132), Qwen Max: 30.7 (#292)

Benchmarko3-miniQwen Max
Aider Polyglot60.4%21.8%
LMArena Coding13781288
SciCode39.8%—
GSO1.3%—
WeirdML43.7%—
LiveBench Coding82.7%—
CadEval54%—

Agentic & Tool Use Not comparable

o3-mini: 29.6 (#84), Qwen Max: —

Benchmarko3-miniQwen Max
Cybench22.5%—

Reasoning Qwen Max leads

o3-mini: 16.3 (#305), Qwen Max: 25.1 (#151)

Benchmarko3-miniQwen Max
LMArena Hard Prompts13661269
ARC-AGI-23%—
SimpleBench22.8%—
ARC-AGI-134.5%—
CritPt0.3%—
Chess Puzzles17%—
LiveBench Reasoning89.6%—
Mystery Game Puzzles7%—
DTBench68.8%—
LiveBench Data Analysis70.6%—
LMCA19%—
Epoch Capabilities Index140.34—
ForecastBench59.6—
LiveBench75.9%—

Math o3-mini leads

o3-mini: 28.1 (#244), Qwen Max: 22.3 (#276)

Benchmarko3-miniQwen Max
OTIS Mock AIME 2024-202576.9%16.1%
LMArena Math13961275
MATH Level 596.5%67.2%
FrontierMath (Feb 2025 set)12.4%1%
FrontierMath (Tiers 1-3)18.6%—
FrontierMath Tier 40%—
LiveBench Math77.3%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge o3-mini leads

o3-mini: 38.3 (#146), Qwen Max: 30.3 (#228)

Benchmarko3-miniQwen Max
GPQA Diamond77%56.1%
LMArena Expert13641248
SimpleQA Verified15.3%—
Confabulations17.9%—

Multilingual o3-mini leads

o3-mini: 45.7 (#164), Qwen Max: 41.8 (#202)

Benchmarko3-miniQwen Max
LMArena Non-English13191263
LMArena Chinese13791254
LMArena French13341330
LMArena German13031254
LMArena Japanese12861205
LMArena Korean13141142
LMArena Russian13041274
LMArena Spanish13211290

Instruction Following o3-mini leads

o3-mini: 75.1 (#72), Qwen Max: 66.5 (#208)

Benchmarko3-miniQwen Max
LMArena Instruction Following13371262
LiveBench Instruction Following84.4%—

Long Context Qwen Max leads

o3-mini: 33.8 (#256), Qwen Max: 39.4 (#180)

Benchmarko3-miniQwen Max
Fiction.LiveBench50%66.7%
LMArena Longer Query13431288

Writing & Preference o3-mini leads

o3-mini: 50.3 (#182), Qwen Max: 47.8 (#205)

Benchmarko3-miniQwen Max
LMArena Text13371282
LMArena Creative Writing12861248
LMArena Multi-Turn13201277
Short-Story Creative Writing61.7%—
LiveBench Language50.7%—

Frequently asked questions

Is o3-mini better than Qwen Max?

o3-mini is the stronger model overall, scoring 36.7 to 34.7 on the Noometry Index.

Which is cheaper, o3-mini or Qwen Max?

o3-mini is cheaper. It lists at $1.10 per million input tokens and $4.40 per million output tokens; Qwen Max lists at $1.60 and $6.40.

Is o3-mini or Qwen Max better for coding?

o3-mini scores higher on coding benchmarks: 40.8 versus 30.7 in the Noometry coding category.

Which has the bigger context window?

o3-mini does, with 200K tokens against 33K.

How many benchmarks do o3-mini and Qwen Max share?

23 benchmarks have published results for both models. o3-mini has 51 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper