Noometry

Model comparison

o1 vs Qwen3.5 Plus

Qwen3.5 Plus is the stronger model overall, scoring 42.9 to 40.9 on the Noometry Index.

Last verified . 8 shared benchmarks.

o1 OpenAI

40.9

Rank #143 Confirmed

Qwen3.5 Plus Alibaba (Qwen)

42.9

Rank #106 Confirmed

Summary

  • They share 8 benchmarks with published results for both. o1 scores higher in 1 category and Qwen3.5 Plus in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.5 Plus leads 49.6 to 36.1.
  • The biggest single-benchmark swing is SimpleQA Verified: 41.1% for o1 and 25.4% for Qwen3.5 Plus.
  • Qwen3.5 Plus is cheaper at $0.40 / $2.40 per million input/output tokens, against $15 / $60 for o1.
  • Qwen3.5 Plus accepts more context: 1M tokens versus 200K.

Side by side

o1Qwen3.5 Plus
ProviderOpenAIAlibaba (Qwen)
Noometry Index40.942.9
Released2024-09-122026-02-16
WeightsProprietaryProprietary
Context window200K1M
Max output100K66K
Input $ / M tokens$15$0.40
Output $ / M tokens$60$2.40
Results tracked5215

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

o1: 46.1 (#70), Qwen3.5 Plus: —

Benchmarko1Qwen3.5 Plus
Aider Polyglot61.7%—
WeirdML47.6%—
LiveBench Coding69.7%—
LMArena Coding1367—
CadEval56%—
ALE-Bench—621.92
HumanEval+89%—
MBPP+80.2%—

Agentic & Tool Use Not comparable

o1: 24.6 (#117), Qwen3.5 Plus: —

Benchmarko1Qwen3.5 Plus
Cybench10%—
METR Time Horizons51.1%—
Vending-Bench 2—0.54

Reasoning Qwen3.5 Plus leads

o1: 27.9 (#111), Qwen3.5 Plus: 32.8 (#74)

Benchmarko1Qwen3.5 Plus
Chess Puzzles15%22%
DTBench74.7%80.5%
LMCA22.3%36.4%
Epoch Capabilities Index141.91146.78
SimpleBench41.7%—
ARC-AGI-130.7%—
EnigmaEval5.7%—
LiveBench Reasoning91.6%—
LMArena Hard Prompts1371—
Mystery Game Puzzles—17%
LiveBench Data Analysis65.5%—
LiveBench75.7%—

Math Qwen3.5 Plus leads

o1: 36.1 (#175), Qwen3.5 Plus: 49.6 (#61)

Benchmarko1Qwen3.5 Plus
OTIS Mock AIME 2024-202573.3%86.7%
FrontierMath (Feb 2025 set)9.3%21%
FrontierMath (Tiers 1-3)14.7%—
LiveBench Math80.3%—
LMArena Math1388—
MATH Level 594.7%—
FrontierMath Tier 4 (v1)—2.1%

Knowledge Qwen3.5 Plus leads

o1: 41.5 (#110), Qwen3.5 Plus: 46.0 (#83)

Benchmarko1Qwen3.5 Plus
GPQA Diamond76.8%84.8%
SimpleQA Verified41.1%25.4%
Humanity's Last Exam8%—
Confabulations11.7%—
Vectara Hallucination Rate—10.7%
LMArena Expert1361—

Multimodal Not comparable

o1: 34.2 (#93), Qwen3.5 Plus: —

Benchmarko1Qwen3.5 Plus
LMArena Vision1168—
GeoBench80%—
VPCT37%—
SpatialViz-Bench41.4%—

Multilingual Not comparable

o1: 48.6 (#142), Qwen3.5 Plus: —

Benchmarko1Qwen3.5 Plus
LMArena Non-English1358—
LMArena Chinese1394—
LMArena French1344—
LMArena German1337—
LMArena Japanese1346—
LMArena Korean1396—
LMArena Russian1356—
LMArena Spanish1345—

Instruction Following Not comparable

o1: 74.8 (#86), Qwen3.5 Plus: —

Benchmarko1Qwen3.5 Plus
LiveBench Instruction Following81.5%—
LMArena Instruction Following1367—

Long Context o1 leads

o1: 50.3 (#9), Qwen3.5 Plus: 43.0 (#113)

Benchmarko1Qwen3.5 Plus
Fiction.LiveBench83.3%—
CL-bench—19.8%
CL-bench Life—12.4%
LMArena Longer Query1378—

Writing & Preference Not comparable

o1: 55.6 (#144), Qwen3.5 Plus: —

Benchmarko1Qwen3.5 Plus
LMArena Text1366—
LMArena Creative Writing1348—
Short-Story Creative Writing70.2%—
LMArena Multi-Turn1369—
LiveBench Language65.4%—

Frequently asked questions

Is o1 better than Qwen3.5 Plus?

Qwen3.5 Plus is the stronger model overall, scoring 42.9 to 40.9 on the Noometry Index.

Which is cheaper, o1 or Qwen3.5 Plus?

Qwen3.5 Plus is cheaper. It lists at $0.40 per million input tokens and $2.40 per million output tokens; o1 lists at $15 and $60.

Which has the bigger context window?

Qwen3.5 Plus does, with 1M tokens against 200K.

How many benchmarks do o1 and Qwen3.5 Plus share?

8 benchmarks have published results for both models. o1 has 52 scored results on Noometry and Qwen3.5 Plus has 15.

Related comparisons

Go deeper