Noometry

Model comparison

Claude 3.7 Sonnet vs Qwen3.7 Flash

Claude 3.7 Sonnet and Qwen3.7 Flash score almost the same on the Noometry Index (39.5 vs 39.9), so choose on price, context window or the category you care about most.

Last verified . 3 shared benchmarks.

Claude 3.7 Sonnet Anthropic

39.5

Rank #164 Confirmed

Qwen3.7 Flash Alibaba (Qwen)

39.9

Rank #156 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Claude 3.7 Sonnet scores higher in 0 categories and Qwen3.7 Flash in 3 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.7 Flash leads 28.2 to 18.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 57.8% for Claude 3.7 Sonnet and 86.7% for Qwen3.7 Flash.

Side by side

Claude 3.7 SonnetQwen3.7 Flash
ProviderAnthropicAlibaba (Qwen)
Noometry Index39.539.9
Released2025-02-242026-07-15
WeightsProprietaryProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$0.03
Output $ / M tokens—$0.13
Results tracked587

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 3.7 Sonnet: 40.6 (#136), Qwen3.7 Flash: —

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
SWE-bench Verified61%—
SWE-bench Verified (bash only)52.8%—
Aider Polyglot64.9%—
GSO3.8%—
LiveBench Coding74.5%—
LMArena Coding1361—
CadEval54%—

Agentic & Tool Use Not comparable

Claude 3.7 Sonnet: 34.1 (#50), Qwen3.7 Flash: —

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
TheAgentCompany30.9%—
Cybench20%—
DeepResearch Bench43.6%—
OSWorld35.8%—
METR Time Horizons60%—

Reasoning Qwen3.7 Flash leads

Claude 3.7 Sonnet: 18.6 (#277), Qwen3.7 Flash: 28.2 (#108)

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
Epoch Capabilities Index141.16144.64
ARC-AGI-20.9%—
SimpleBench46.4%—
NYT Connections (extended)—43.8%
ARC-AGI-128.6%—
Chess Puzzles—23%
EnigmaEval4.2%—
LiveBench Reasoning87.8%—
LMArena Hard Prompts1333—
Mystery Game Puzzles—15%
LiveBench Data Analysis74%—
ForecastBench61.8—
LiveBench76.1%—

Math Too close to call

Claude 3.7 Sonnet: 37.5 (#153), Qwen3.7 Flash: 38.3 (#140)

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
OTIS Mock AIME 2024-202557.8%86.7%
FrontierMath (Tiers 1-3)—19.3%
Omni-MATH33%—
LiveBench Math79%—
LMArena Math1337—
MATH Level 591.2%—
FrontierMath (Feb 2025 set)4.1%—

Knowledge Qwen3.7 Flash leads

Claude 3.7 Sonnet: 39.8 (#130), Qwen3.7 Flash: 48.9 (#75)

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
GPQA Diamond79.7%82.3%
Humanity's Last Exam8%—
MMLU-Pro78.4%—
Confabulations14.7%—
GPQA (HELM)60.8%—
LMArena Expert1321—

Multimodal Not comparable

Claude 3.7 Sonnet: 33.7 (#95), Qwen3.7 Flash: —

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
LMArena Vision1169—
GeoBench68%—
VPCT39%—
SpatialViz-Bench33.9%—

Multilingual Not comparable

Claude 3.7 Sonnet: 44.1 (#179), Qwen3.7 Flash: —

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
LMArena Non-English1296—
LMArena Chinese1299—
LMArena French1303—
LMArena German1301—
LMArena Japanese1267—
LMArena Korean1249—
LMArena Russian1311—
LMArena Spanish1298—

Instruction Following Not comparable

Claude 3.7 Sonnet: 72.9 (#125), Qwen3.7 Flash: —

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
LiveBench Instruction Following81.3%—
IFEval83.4%—
LMArena Instruction Following1352—

Long Context Not comparable

Claude 3.7 Sonnet: 50.3 (#10), Qwen3.7 Flash: —

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
Fiction.LiveBench83.3%—
LMArena Longer Query1373—

Writing & Preference Not comparable

Claude 3.7 Sonnet: 54.4 (#150), Qwen3.7 Flash: —

BenchmarkClaude 3.7 SonnetQwen3.7 Flash
LMArena Text1314—
LMArena Creative Writing1332—
Short-Story Creative Writing81.1%—
EQ-Bench Creative Writing1412—
WildBench81.4%—
LMArena Multi-Turn1339—
LiveBench Language59.9%—

Frequently asked questions

Is Claude 3.7 Sonnet better than Qwen3.7 Flash?

Claude 3.7 Sonnet and Qwen3.7 Flash score almost the same on the Noometry Index (39.5 vs 39.9), so choose on price, context window or the category you care about most.

How many benchmarks do Claude 3.7 Sonnet and Qwen3.7 Flash share?

3 benchmarks have published results for both models. Claude 3.7 Sonnet has 58 scored results on Noometry and Qwen3.7 Flash has 7.

Related comparisons

Go deeper