Noometry

Model comparison

o1 vs Qwen3.7 Flash

o1 and Qwen3.7 Flash score almost the same on the Noometry Index (40.9 vs 39.9), so choose on price, context window or the category you care about most.

Last verified . 5 shared benchmarks.

o1 OpenAI

40.9

Rank #143 Confirmed

Qwen3.7 Flash Alibaba (Qwen)

39.9

Rank #156 Confirmed

Summary

  • They share 5 benchmarks with published results for both. o1 scores higher in 0 categories and Qwen3.7 Flash in 3 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Flash leads 48.9 to 41.5.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 73.3% for o1 and 86.7% for Qwen3.7 Flash.
  • Qwen3.7 Flash is cheaper at $0.03 / $0.13 per million input/output tokens, against $15 / $60 for o1.
  • Qwen3.7 Flash accepts more context: 1M tokens versus 200K.

Side by side

o1Qwen3.7 Flash
ProviderOpenAIAlibaba (Qwen)
Noometry Index40.939.9
Released2024-09-122026-07-15
WeightsProprietaryProprietary
Context window200K1M
Max output100K131K
Input $ / M tokens$15$0.03
Output $ / M tokens$60$0.13
Results tracked527

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

o1: 46.1 (#70), Qwen3.7 Flash: —

Benchmarko1Qwen3.7 Flash
Aider Polyglot61.7%—
WeirdML47.6%—
LiveBench Coding69.7%—
LMArena Coding1367—
CadEval56%—
HumanEval+89%—
MBPP+80.2%—

Agentic & Tool Use Not comparable

o1: 24.6 (#117), Qwen3.7 Flash: —

Benchmarko1Qwen3.7 Flash
Cybench10%—
METR Time Horizons51.1%—

Reasoning Too close to call

o1: 27.9 (#111), Qwen3.7 Flash: 28.2 (#108)

Benchmarko1Qwen3.7 Flash
Chess Puzzles15%23%
Epoch Capabilities Index141.91144.64
SimpleBench41.7%—
NYT Connections (extended)—43.8%
ARC-AGI-130.7%—
EnigmaEval5.7%—
LiveBench Reasoning91.6%—
LMArena Hard Prompts1371—
Mystery Game Puzzles—15%
DTBench74.7%—
LiveBench Data Analysis65.5%—
LMCA22.3%—
LiveBench75.7%—

Math Qwen3.7 Flash leads

o1: 36.1 (#175), Qwen3.7 Flash: 38.3 (#140)

Benchmarko1Qwen3.7 Flash
FrontierMath (Tiers 1-3)14.7%19.3%
OTIS Mock AIME 2024-202573.3%86.7%
LiveBench Math80.3%—
LMArena Math1388—
MATH Level 594.7%—
FrontierMath (Feb 2025 set)9.3%—

Knowledge Qwen3.7 Flash leads

o1: 41.5 (#110), Qwen3.7 Flash: 48.9 (#75)

Benchmarko1Qwen3.7 Flash
GPQA Diamond76.8%82.3%
Humanity's Last Exam8%—
SimpleQA Verified41.1%—
Confabulations11.7%—
LMArena Expert1361—

Multimodal Not comparable

o1: 34.2 (#93), Qwen3.7 Flash: —

Benchmarko1Qwen3.7 Flash
LMArena Vision1168—
GeoBench80%—
VPCT37%—
SpatialViz-Bench41.4%—

Multilingual Not comparable

o1: 48.6 (#142), Qwen3.7 Flash: —

Benchmarko1Qwen3.7 Flash
LMArena Non-English1358—
LMArena Chinese1394—
LMArena French1344—
LMArena German1337—
LMArena Japanese1346—
LMArena Korean1396—
LMArena Russian1356—
LMArena Spanish1345—

Instruction Following Not comparable

o1: 74.8 (#86), Qwen3.7 Flash: —

Benchmarko1Qwen3.7 Flash
LiveBench Instruction Following81.5%—
LMArena Instruction Following1367—

Long Context Not comparable

o1: 50.3 (#9), Qwen3.7 Flash: —

Benchmarko1Qwen3.7 Flash
Fiction.LiveBench83.3%—
LMArena Longer Query1378—

Writing & Preference Not comparable

o1: 55.6 (#144), Qwen3.7 Flash: —

Benchmarko1Qwen3.7 Flash
LMArena Text1366—
LMArena Creative Writing1348—
Short-Story Creative Writing70.2%—
LMArena Multi-Turn1369—
LiveBench Language65.4%—

Frequently asked questions

Is o1 better than Qwen3.7 Flash?

o1 and Qwen3.7 Flash score almost the same on the Noometry Index (40.9 vs 39.9), so choose on price, context window or the category you care about most.

Which is cheaper, o1 or Qwen3.7 Flash?

Qwen3.7 Flash is cheaper. It lists at $0.03 per million input tokens and $0.13 per million output tokens; o1 lists at $15 and $60.

Which has the bigger context window?

Qwen3.7 Flash does, with 1M tokens against 200K.

How many benchmarks do o1 and Qwen3.7 Flash share?

5 benchmarks have published results for both models. o1 has 52 scored results on Noometry and Qwen3.7 Flash has 7.

Related comparisons

Go deeper