Noometry

Model comparison

o1-mini vs Qwen3.7 Max

Qwen3.7 Max is the stronger model overall, scoring 51.4 to 33.7 on the Noometry Index.

Last verified . 16 shared benchmarks.

o1-mini OpenAI

33.7

Rank #230 Confirmed

Qwen3.7 Max Alibaba (Qwen)

51.4

Rank #35 Confirmed

Summary

  • They share 16 benchmarks with published results for both. o1-mini scores higher in 1 category and Qwen3.7 Max in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.7 Max leads 48.4 to 8.9.
  • The biggest single-benchmark swing is SimpleBench: 18.1% for o1-mini and 70.4% for Qwen3.7 Max.

Side by side

o1-miniQwen3.7 Max
ProviderOpenAIAlibaba (Qwen)
Noometry Index33.751.4
Released2024-09-122026-05-19
WeightsProprietaryProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$2.50
Output $ / M tokens—$7.50
Results tracked3933

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Max leads

o1-mini: 35.1 (#218), Qwen3.7 Max: 50.2 (#43)

Benchmarko1-miniQwen3.7 Max
LMArena Coding13621498
SWE-bench Verified—77.3%
Aider Polyglot32.9%—
LMArena WebDev—1515
SciCode—48.8%
WeirdML36.3%—
LiveBench Coding48%—
ALE-Bench—1,189
HumanEval+89%—
MBPP+78.8%—

Agentic & Tool Use o1-mini leads

o1-mini: 24.3 (#112), Qwen3.7 Max: 21.8 (#129)

Benchmarko1-miniQwen3.7 Max
Cybench10%—
GBAEval—0.4%

Reasoning Qwen3.7 Max leads

o1-mini: 8.9 (#340), Qwen3.7 Max: 48.4 (#36)

Benchmarko1-miniQwen3.7 Max
SimpleBench18.1%70.4%
LMArena Hard Prompts13331483
Epoch Capabilities Index135.82153.74
ARC-AGI-20.8%—
NYT Connections (extended)—85.1%
ARC-AGI-114%—
CritPt—13.4%
Chess Puzzles—19%
EBR-Bench—9.5%
LiveBench Reasoning72.3%—
Mystery Game Puzzles—32%
DTBench—92.3%
LiveBench Data Analysis57.9%—
LMCA—44%
LiveBench57.8%—

Math Qwen3.7 Max leads

o1-mini: 33.7 (#168), Qwen3.7 Max: 62.3 (#26)

Benchmarko1-miniQwen3.7 Max
OTIS Mock AIME 2024-202546.9%95.6%
LMArena Math13581488
FrontierMath (Tiers 1-3)—64.6%
FrontierMath Tier 4—34.1%
ProofBench—26%
LiveBench Math62%—
MATH Level 589.2%—
FrontierMath (Feb 2025 set)1.7%—

Knowledge Qwen3.7 Max leads

o1-mini: 34.8 (#180), Qwen3.7 Max: 61.7 (#24)

Benchmarko1-miniQwen3.7 Max
GPQA Diamond62.4%90.9%
LMArena Expert13161488
SimpleQA Verified—55.8%
Confabulations18.6%—

Multilingual Qwen3.7 Max leads

o1-mini: 43.8 (#177), Qwen3.7 Max: 57.1 (#13)

Benchmarko1-miniQwen3.7 Max
LMArena Non-English12891475
LMArena Chinese13141533
LMArena Russian12831482
LMArena French1292—
LMArena German1278—
LMArena Japanese1245—
LMArena Korean1223—
LMArena Spanish1302—

Instruction Following Qwen3.7 Max leads

o1-mini: 67.0 (#200), Qwen3.7 Max: 76.9 (#34)

Benchmarko1-miniQwen3.7 Max
LMArena Instruction Following13041460
LiveBench Instruction Following65.4%—

Long Context Qwen3.7 Max leads

o1-mini: 40.1 (#156), Qwen3.7 Max: 45.4 (#34)

Benchmarko1-miniQwen3.7 Max
LMArena Longer Query13211484

Writing & Preference Qwen3.7 Max leads

o1-mini: 48.6 (#196), Qwen3.7 Max: 65.2 (#52)

Benchmarko1-miniQwen3.7 Max
LMArena Text13171476
LMArena Creative Writing12441450
LMArena Multi-Turn13141482
Short-Story Creative Writing64.9%—
EQ-Bench 4—1110
LiveBench Language40.9%—

Frequently asked questions

Is o1-mini better than Qwen3.7 Max?

Qwen3.7 Max is the stronger model overall, scoring 51.4 to 33.7 on the Noometry Index.

Is o1-mini or Qwen3.7 Max better for coding?

Qwen3.7 Max scores higher on coding benchmarks: 50.2 versus 35.1 in the Noometry coding category.

How many benchmarks do o1-mini and Qwen3.7 Max share?

16 benchmarks have published results for both models. o1-mini has 39 scored results on Noometry and Qwen3.7 Max has 33.

Related comparisons

Go deeper