Noometry

Model comparison

o1-mini vs Qwen3-VL 235B-A22B

Qwen3-VL 235B-A22B is the stronger model overall, scoring 42.5 to 33.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

o1-mini OpenAI

33.7

Rank #230 Confirmed

Qwen3-VL 235B-A22B Alibaba (Qwen)

42.5

Rank #98 Confirmed

Summary

  • They share 17 benchmarks with published results for both. o1-mini scores higher in 0 categories and Qwen3-VL 235B-A22B in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3-VL 235B-A22B leads 28.1 to 8.9.
  • Qwen3-VL 235B-A22B has downloadable open weights; the other is API-only.

Side by side

o1-miniQwen3-VL 235B-A22B
ProviderOpenAIAlibaba (Qwen)
Noometry Index33.742.5
Released2024-09-122025-04
WeightsProprietaryOpen
Context window—131K
Max output—33K
Input $ / M tokens—$0.70
Output $ / M tokens—$2.80
Results tracked3918

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3-VL 235B-A22B leads

o1-mini: 35.1 (#218), Qwen3-VL 235B-A22B: 41.8 (#103)

Benchmarko1-miniQwen3-VL 235B-A22B
LMArena Coding13621438
Aider Polyglot32.9%—
WeirdML36.3%—
LiveBench Coding48%—
HumanEval+89%—
MBPP+78.8%—

Agentic & Tool Use Not comparable

o1-mini: 24.3 (#112), Qwen3-VL 235B-A22B: —

Benchmarko1-miniQwen3-VL 235B-A22B
Cybench10%—

Reasoning Qwen3-VL 235B-A22B leads

o1-mini: 8.9 (#340), Qwen3-VL 235B-A22B: 28.1 (#92)

Benchmarko1-miniQwen3-VL 235B-A22B
LMArena Hard Prompts13331428
ARC-AGI-20.8%—
SimpleBench18.1%—
ARC-AGI-114%—
LiveBench Reasoning72.3%—
LiveBench Data Analysis57.9%—
Epoch Capabilities Index135.82—
LiveBench57.8%—

Math Qwen3-VL 235B-A22B leads

o1-mini: 33.7 (#168), Qwen3-VL 235B-A22B: 36.2 (#120)

Benchmarko1-miniQwen3-VL 235B-A22B
LMArena Math13581426
OTIS Mock AIME 2024-202546.9%—
LiveBench Math62%—
MATH Level 589.2%—
FrontierMath (Feb 2025 set)1.7%—

Knowledge Qwen3-VL 235B-A22B leads

o1-mini: 34.8 (#180), Qwen3-VL 235B-A22B: 39.6 (#120)

Benchmarko1-miniQwen3-VL 235B-A22B
LMArena Expert13161440
GPQA Diamond62.4%—
Confabulations18.6%—

Multimodal Not comparable

o1-mini: —, Qwen3-VL 235B-A22B: 39.1 (#50)

Benchmarko1-miniQwen3-VL 235B-A22B
LMArena Vision—1247

Multilingual Qwen3-VL 235B-A22B leads

o1-mini: 43.8 (#177), Qwen3-VL 235B-A22B: 52.1 (#92)

Benchmarko1-miniQwen3-VL 235B-A22B
LMArena Non-English12891405
LMArena Chinese13141462
LMArena French12921448
LMArena German12781424
LMArena Japanese12451385
LMArena Korean12231395
LMArena Russian12831409
LMArena Spanish13021427

Instruction Following Qwen3-VL 235B-A22B leads

o1-mini: 67.0 (#200), Qwen3-VL 235B-A22B: 74.4 (#95)

Benchmarko1-miniQwen3-VL 235B-A22B
LMArena Instruction Following13041407
LiveBench Instruction Following65.4%—

Long Context Qwen3-VL 235B-A22B leads

o1-mini: 40.1 (#156), Qwen3-VL 235B-A22B: 43.4 (#93)

Benchmarko1-miniQwen3-VL 235B-A22B
LMArena Longer Query13211420

Writing & Preference Qwen3-VL 235B-A22B leads

o1-mini: 48.6 (#196), Qwen3-VL 235B-A22B: 60.4 (#94)

Benchmarko1-miniQwen3-VL 235B-A22B
LMArena Text13171420
LMArena Creative Writing12441367
LMArena Multi-Turn13141428
Short-Story Creative Writing64.9%—
LiveBench Language40.9%—

Frequently asked questions

Is o1-mini better than Qwen3-VL 235B-A22B?

Qwen3-VL 235B-A22B is the stronger model overall, scoring 42.5 to 33.7 on the Noometry Index.

Is o1-mini or Qwen3-VL 235B-A22B better for coding?

Qwen3-VL 235B-A22B scores higher on coding benchmarks: 41.8 versus 35.1 in the Noometry coding category.

How many benchmarks do o1-mini and Qwen3-VL 235B-A22B share?

17 benchmarks have published results for both models. o1-mini has 39 scored results on Noometry and Qwen3-VL 235B-A22B has 18.

Related comparisons

Go deeper