Model comparison

o1 vs Qwen3.6 Max Preview

Qwen3.6 Max Preview is the stronger model overall, scoring 51.1 to 40.6 on the Noometry Index.

Last verified . 23 shared benchmarks.

o1 OpenAI

40.6

Rank #140 Confirmed

Qwen3.6 Max Preview Alibaba (Qwen)

51.1

Rank #36 Confirmed

Summary

  • They share 23 benchmarks with published results for both. o1 scores higher in 1 category and Qwen3.6 Max Preview in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.6 Max Preview leads 52.2 to 34.9.
  • The biggest single-benchmark swing is SimpleBench: 41.7% for o1 and 63% for Qwen3.6 Max Preview.
  • Qwen3.6 Max Preview is cheaper at $1.30 / $7.80 per million input/output tokens, against $15 / $60 for o1.
  • Qwen3.6 Max Preview accepts more context: 262K tokens versus 200K.

Side by side

o1 and Qwen3.6 Max Preview specifications
o1Qwen3.6 Max Preview
ProviderOpenAIAlibaba (Qwen)
Noometry Index40.651.1
Released2024-09-122026-04-20
WeightsProprietaryProprietary
Context window200K262K
Max output100K66K
Input $ / M tokens$15$1.30
Output $ / M tokens$60$7.80
Results tracked5229

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.6 Max Preview leads

o1: 45.7 (#64), Qwen3.6 Max Preview: 48.6 (#50)

Coding benchmarks
Benchmarko1Qwen3.6 Max Preview
LMArena Coding13671472
SWE-bench Verified—76.7%
Aider Polyglot61.7%—
LMArena WebDev—1482
WeirdML47.6%—
LiveBench Coding69.7%—
CadEval56%—
HumanEval+89%—
MBPP+80.2%—

Agentic & Tool Use Not comparable

o1: 24.3 (#111), Qwen3.6 Max Preview: —

Agentic & Tool Use benchmarks
Benchmarko1Qwen3.6 Max Preview
Cybench10%—
METR Time Horizons51.1%—
Vending-Bench 2—4,254

Reasoning Qwen3.6 Max Preview leads

o1: 27.5 (#103), Qwen3.6 Max Preview: 40.8 (#47)

Reasoning benchmarks
Benchmarko1Qwen3.6 Max Preview
SimpleBench41.7%63%
Chess Puzzles15%20%
LMArena Hard Prompts13721457
DTBench74.7%87.2%
LMCA22.3%42.5%
Epoch Capabilities Index141.92149.27
NYT Connections (extended)—74.1%
ARC-AGI-130.7%—
EnigmaEval5.7%—
LiveBench Reasoning91.6%—
Mystery Game Puzzles—19%
LiveBench Data Analysis65.5%—
LiveBench75.7%—

Math Qwen3.6 Max Preview leads

o1: 34.9 (#150), Qwen3.6 Max Preview: 52.2 (#40)

Math benchmarks
Benchmarko1Qwen3.6 Max Preview
OTIS Mock AIME 2024-202573.3%91.1%
LMArena Math13881465
FrontierMath (Feb 2025 set)9.3%23.1%
FrontierMath (Tiers 1-3)14.7%—
LiveBench Math80.3%—
MATH Level 594.7%—
FrontierMath Tier 4 (v1)—4.2%

Knowledge Qwen3.6 Max Preview leads

o1: 41.5 (#101), Qwen3.6 Max Preview: 57.6 (#35)

Knowledge benchmarks
Benchmarko1Qwen3.6 Max Preview
GPQA Diamond76.8%87.4%
SimpleQA Verified41.1%52%
LMArena Expert13621476
Humanity's Last Exam8%—
Confabulations11.7%—

Multimodal Not comparable

o1: 33.6 (#87), Qwen3.6 Max Preview: —

Multimodal benchmarks
Benchmarko1Qwen3.6 Max Preview
LMArena Vision1168—
GeoBench80%—
VPCT37%—
SpatialViz-Bench41.4%—

Multilingual Qwen3.6 Max Preview leads

o1: 48.8 (#137), Qwen3.6 Max Preview: 54.3 (#46)

Multilingual benchmarks
Benchmarko1Qwen3.6 Max Preview
LMArena Non-English13591436
LMArena Chinese13941487
LMArena French13431449
LMArena Russian13561444
LMArena Spanish13451452
LMArena German1337—
LMArena Japanese1346—
LMArena Korean1396—

Instruction Following Too close to call

o1: 75.0 (#82), Qwen3.6 Max Preview: 75.8 (#51)

Instruction Following benchmarks
Benchmarko1Qwen3.6 Max Preview
LMArena Instruction Following13681437
LiveBench Instruction Following81.5%—

Long Context o1 leads

o1: 50.3 (#9), Qwen3.6 Max Preview: 44.6 (#59)

Long Context benchmarks
Benchmarko1Qwen3.6 Max Preview
LMArena Longer Query13781457
Fiction.LiveBench83.3%—

Writing & Preference Qwen3.6 Max Preview leads

o1: 55.8 (#139), Qwen3.6 Max Preview: 64.0 (#58)

Writing & Preference benchmarks
Benchmarko1Qwen3.6 Max Preview
LMArena Text13661447
LMArena Creative Writing13471435
LMArena Multi-Turn13681456
Short-Story Creative Writing70.2%—
LiveBench Language65.4%—

Frequently asked questions

Is o1 better than Qwen3.6 Max Preview?

Qwen3.6 Max Preview is the stronger model overall, scoring 51.1 to 40.6 on the Noometry Index.

Which is cheaper, o1 or Qwen3.6 Max Preview?

Qwen3.6 Max Preview is cheaper. It lists at $1.30 per million input tokens and $7.80 per million output tokens; o1 lists at $15 and $60.

Is o1 or Qwen3.6 Max Preview better for coding?

Qwen3.6 Max Preview scores higher on coding benchmarks: 48.6 versus 45.7 in the Noometry coding category.

Which has the bigger context window?

Qwen3.6 Max Preview does, with 262K tokens against 200K.

How many benchmarks do o1 and Qwen3.6 Max Preview share?

23 benchmarks have published results for both models. o1 has 52 scored results on Noometry and Qwen3.6 Max Preview has 29.

Related comparisons

Go deeper