Noometry

Model comparison

o3-mini vs Qwen3.5 35B-A3B

Qwen3.5 35B-A3B is the stronger model overall, scoring 41.7 to 36.7 on the Noometry Index.

Last verified . 25 shared benchmarks.

o3-mini OpenAI

36.7

Rank #205 Confirmed

Qwen3.5 35B-A3B Alibaba (Qwen)

41.7

Rank #118 Confirmed

Summary

  • They share 25 benchmarks with published results for both. o3-mini scores higher in 2 categories and Qwen3.5 35B-A3B in 6 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.5 35B-A3B leads 38.4 to 27.6.
  • The biggest single-benchmark swing is DTBench: 68.8% for o3-mini and 80% for Qwen3.5 35B-A3B.
  • Qwen3.5 35B-A3B is cheaper at $0.25 / $2 per million input/output tokens, against $1.10 / $4.40 for o3-mini.
  • Qwen3.5 35B-A3B accepts more context: 262K tokens versus 200K.
  • Qwen3.5 35B-A3B has downloadable open weights; the other is API-only.

Side by side

o3-miniQwen3.5 35B-A3B
ProviderOpenAIAlibaba (Qwen)
Noometry Index36.741.7
Released2024-12-202026-02-01
WeightsProprietaryOpen
Context window200K262K
Max output100K66K
Input $ / M tokens$1.10$0.25
Output $ / M tokens$4.40$2
Results tracked5128

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3-mini leads

o3-mini: 41.4 (#116), Qwen3.5 35B-A3B: 33.5 (#244)

Benchmarko3-miniQwen3.5 35B-A3B
SciCode39.8%29.3%
LMArena Coding13781410
Aider Polyglot60.4%—
LMArena WebDev—1254
GSO1.3%—
WeirdML43.7%—
LiveBench Coding82.7%—
CadEval54%—

Agentic & Tool Use Not comparable

o3-mini: 29.3 (#79), Qwen3.5 35B-A3B: —

Benchmarko3-miniQwen3.5 35B-A3B
Cybench22.5%—

Reasoning Qwen3.5 35B-A3B leads

o3-mini: 16.3 (#295), Qwen3.5 35B-A3B: 23.9 (#158)

Benchmarko3-miniQwen3.5 35B-A3B
CritPt0.3%0.6%
Chess Puzzles17%10%
LMArena Hard Prompts13661400
DTBench68.8%80%
LMCA19%29.5%
Epoch Capabilities Index140.35142.52
ARC-AGI-23%—
SimpleBench22.8%—
ARC-AGI-134.5%—
LiveBench Reasoning89.6%—
Mystery Game Puzzles7%—
LiveBench Data Analysis70.6%—
ForecastBench59.6—
LiveBench75.9%—

Math Qwen3.5 35B-A3B leads

o3-mini: 27.6 (#236), Qwen3.5 35B-A3B: 38.4 (#86)

Benchmarko3-miniQwen3.5 35B-A3B
OTIS Mock AIME 2024-202576.9%70%
LMArena Math13961404
FrontierMath (Tiers 1-3)18.6%—
FrontierMath Tier 40%—
MathArena Final-Answer Competitions—56%
LiveBench Math77.3%—
MATH Level 596.5%—
FrontierMath (Feb 2025 set)12.4%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Qwen3.5 35B-A3B leads

o3-mini: 38.3 (#135), Qwen3.5 35B-A3B: 47.7 (#73)

Benchmarko3-miniQwen3.5 35B-A3B
GPQA Diamond77%83.5%
LMArena Expert13641408
SimpleQA Verified15.3%—
Confabulations17.9%—
Vectara Hallucination Rate—10.5%

Multilingual Qwen3.5 35B-A3B leads

o3-mini: 45.9 (#159), Qwen3.5 35B-A3B: 50.2 (#122)

Benchmarko3-miniQwen3.5 35B-A3B
LMArena Non-English13191379
LMArena Chinese13791458
LMArena French13331412
LMArena German13031367
LMArena Japanese12861326
LMArena Korean13141354
LMArena Russian13041377
LMArena Spanish13211390

Instruction Following o3-mini leads

o3-mini: 75.3 (#67), Qwen3.5 35B-A3B: 73.0 (#123)

Benchmarko3-miniQwen3.5 35B-A3B
LMArena Instruction Following13381379
LiveBench Instruction Following84.4%—

Long Context Qwen3.5 35B-A3B leads

o3-mini: 33.8 (#251), Qwen3.5 35B-A3B: 42.4 (#122)

Benchmarko3-miniQwen3.5 35B-A3B
LMArena Longer Query13431390
Fiction.LiveBench50%—

Writing & Preference Qwen3.5 35B-A3B leads

o3-mini: 50.4 (#177), Qwen3.5 35B-A3B: 58.1 (#118)

Benchmarko3-miniQwen3.5 35B-A3B
LMArena Text13371395
LMArena Creative Writing12861347
LMArena Multi-Turn13201391
Short-Story Creative Writing61.7%—
LiveBench Language50.7%—

Frequently asked questions

Is o3-mini better than Qwen3.5 35B-A3B?

Qwen3.5 35B-A3B is the stronger model overall, scoring 41.7 to 36.7 on the Noometry Index.

Which is cheaper, o3-mini or Qwen3.5 35B-A3B?

Qwen3.5 35B-A3B is cheaper. It lists at $0.25 per million input tokens and $2 per million output tokens; o3-mini lists at $1.10 and $4.40.

Is o3-mini or Qwen3.5 35B-A3B better for coding?

o3-mini scores higher on coding benchmarks: 41.4 versus 33.5 in the Noometry coding category.

Which has the bigger context window?

Qwen3.5 35B-A3B does, with 262K tokens against 200K.

How many benchmarks do o3-mini and Qwen3.5 35B-A3B share?

25 benchmarks have published results for both models. o3-mini has 51 scored results on Noometry and Qwen3.5 35B-A3B has 28.

Related comparisons

Go deeper