Noometry

Model comparison

Claude Sonnet 4 vs Qwen3.7 Flash

Claude Sonnet 4 and Qwen3.7 Flash score almost the same on the Noometry Index (40.8 vs 39.9), so choose on price, context window or the category you care about most.

Last verified . 3 shared benchmarks.

Claude Sonnet 4 Anthropic

40.8

Rank #145 Confirmed

Qwen3.7 Flash Alibaba (Qwen)

39.9

Rank #156 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Claude Sonnet 4 scores higher in 1 category and Qwen3.7 Flash in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Flash leads 48.9 to 41.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 71.1% for Claude Sonnet 4 and 86.7% for Qwen3.7 Flash.
  • Qwen3.7 Flash is cheaper at $0.03 / $0.13 per million input/output tokens, against $3 / $15 for Claude Sonnet 4.
  • Qwen3.7 Flash accepts more context: 1M tokens versus 200K.

Side by side

Claude Sonnet 4Qwen3.7 Flash
ProviderAnthropicAlibaba (Qwen)
Noometry Index40.839.9
Released2025-05-222026-07-15
WeightsProprietaryProprietary
Context window200K1M
Max output64K131K
Input $ / M tokens$3$0.03
Output $ / M tokens$15$0.13
Results tracked587

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Sonnet 4: 43.5 (#88), Qwen3.7 Flash: —

BenchmarkClaude Sonnet 4Qwen3.7 Flash
SWE-bench Verified (bash only)64.9%—
Aider Polyglot61.3%—
SciCode40%—
GSO4.9%—
WeirdML46.1%—
LMArena Coding1414—
ALE-Bench655.35—

Agentic & Tool Use Not comparable

Claude Sonnet 4: 38.5 (#31), Qwen3.7 Flash: —

BenchmarkClaude Sonnet 4Qwen3.7 Flash
TheAgentCompany33.1%—
Cybench35%—
DeepResearch Bench46.6%—
OSWorld43.9%—
METR Time Horizons62%—

Reasoning Qwen3.7 Flash leads

Claude Sonnet 4: 22.9 (#187), Qwen3.7 Flash: 28.2 (#108)

BenchmarkClaude Sonnet 4Qwen3.7 Flash
Epoch Capabilities Index141.69144.64
ARC-AGI-25.9%—
SimpleBench45.5%—
Kagi LLM Benchmark73%—
NYT Connections (extended)—43.8%
ARC-AGI-140%—
CritPt0.3%—
Chess Puzzles—23%
EnigmaEval3.1%—
LMArena Hard Prompts1372—
Mystery Game Puzzles—15%
DTBench77.1%—
LMCA29%—
ForecastBench60.2—

Math Claude Sonnet 4 leads

Claude Sonnet 4: 43.3 (#80), Qwen3.7 Flash: 38.3 (#140)

BenchmarkClaude Sonnet 4Qwen3.7 Flash
OTIS Mock AIME 2024-202571.1%86.7%
FrontierMath (Tiers 1-3)—19.3%
Omni-MATH60.2%—
LMArena Math1375—
MATH Level 584.4%—
FrontierMath (Feb 2025 set)4.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Qwen3.7 Flash leads

Claude Sonnet 4: 41.8 (#108), Qwen3.7 Flash: 48.9 (#75)

BenchmarkClaude Sonnet 4Qwen3.7 Flash
GPQA Diamond79.2%82.3%
Humanity's Last Exam7.8%—
MMLU-Pro84.3%—
Confabulations13.2%—
Vectara Hallucination Rate10.3%—
GPQA (HELM)70.6%—
LMArena Expert1372—

Multimodal Not comparable

Claude Sonnet 4: 26.2 (#121), Qwen3.7 Flash: —

BenchmarkClaude Sonnet 4Qwen3.7 Flash
LMArena Vision1191—
GeoBench37%—
VPCT34%—
MindCube44.8%—

Multilingual Not comparable

Claude Sonnet 4: 46.7 (#156), Qwen3.7 Flash: —

BenchmarkClaude Sonnet 4Qwen3.7 Flash
LMArena Non-English1333—
LMArena Chinese1350—
LMArena French1363—
LMArena German1331—
LMArena Japanese1302—
LMArena Korean1291—
LMArena Russian1355—
LMArena Spanish1357—

Instruction Following Not comparable

Claude Sonnet 4: 71.7 (#145), Qwen3.7 Flash: —

BenchmarkClaude Sonnet 4Qwen3.7 Flash
IFEval84%—
LMArena Instruction Following1376—

Long Context Not comparable

Claude Sonnet 4: 33.7 (#259), Qwen3.7 Flash: —

BenchmarkClaude Sonnet 4Qwen3.7 Flash
Fiction.LiveBench46.9%—
LMArena Longer Query1398—

Writing & Preference Not comparable

Claude Sonnet 4: 57.1 (#132), Qwen3.7 Flash: —

BenchmarkClaude Sonnet 4Qwen3.7 Flash
LMArena Text1351—
LMArena Creative Writing1345—
Short-Story Creative Writing81.4%—
EQ-Bench Creative Writing1483—
WildBench83.8%—
LMArena Multi-Turn1376—

Frequently asked questions

Is Claude Sonnet 4 better than Qwen3.7 Flash?

Claude Sonnet 4 and Qwen3.7 Flash score almost the same on the Noometry Index (40.8 vs 39.9), so choose on price, context window or the category you care about most.

Which is cheaper, Claude Sonnet 4 or Qwen3.7 Flash?

Qwen3.7 Flash is cheaper. It lists at $0.03 per million input tokens and $0.13 per million output tokens; Claude Sonnet 4 lists at $3 and $15.

Which has the bigger context window?

Qwen3.7 Flash does, with 1M tokens against 200K.

How many benchmarks do Claude Sonnet 4 and Qwen3.7 Flash share?

3 benchmarks have published results for both models. Claude Sonnet 4 has 58 scored results on Noometry and Qwen3.7 Flash has 7.

Related comparisons

Go deeper