Noometry

Model comparison

Claude 3 Opus vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 29.5 on the Noometry Index.

Last verified . 24 shared benchmarks.

Claude 3 Opus Anthropic

29.5

Rank #310 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Claude 3 Opus scores higher in 1 category and Qwen3.7 Plus in 9 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.7 Plus leads 50.5 to 14.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.7% for Claude 3 Opus and 93.3% for Qwen3.7 Plus.

Side by side

Claude 3 OpusQwen3.7 Plus
ProviderAnthropicAlibaba (Qwen)
Noometry Index29.545.3
Released2024-02-292026-06-02
WeightsProprietaryProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.60
Results tracked4632

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Plus leads

Claude 3 Opus: 32.9 (#267), Qwen3.7 Plus: 36.6 (#206)

BenchmarkClaude 3 OpusQwen3.7 Plus
LMArena Coding12641473
FrontierCode—10.2%
SciCode—45.5%
WeirdML19.2%—
BigCodeBench Instruct45.5%—
LiveBench Coding38.6%—
BigCodeBench Complete57.4%—
HumanEval+77.4%—
MBPP+73.3%—

Agentic & Tool Use Claude 3 Opus leads

Claude 3 Opus: 24.6 (#116), Qwen3.7 Plus: 21.4 (#138)

BenchmarkClaude 3 OpusQwen3.7 Plus
OSWorld 2.0—2.8%
Cybench10%—
METR Time Horizons29.5%—

Reasoning Qwen3.7 Plus leads

Claude 3 Opus: 14.6 (#324), Qwen3.7 Plus: 39.3 (#59)

BenchmarkClaude 3 OpusQwen3.7 Plus
Chess Puzzles5%24%
LMArena Hard Prompts12451460
DTBench61.6%84%
LMCA17%37.6%
Epoch Capabilities Index126.91147.37
SimpleBench23.5%—
NYT Connections (extended)—74.8%
CritPt—9.1%
EnigmaEval0.8%—
LiveBench Reasoning40.6%—
Mystery Game Puzzles—17%
LiveBench Data Analysis57.9%—
ForecastBench58.4—
LiveBench49.2%—
WinoGrande88.5%—

Math Qwen3.7 Plus leads

Claude 3 Opus: 14.8 (#299), Qwen3.7 Plus: 50.5 (#56)

BenchmarkClaude 3 OpusQwen3.7 Plus
OTIS Mock AIME 2024-20254.7%93.3%
LMArena Math12731466
FrontierMath (Tiers 1-3)—34.4%
LiveBench Math43.6%—
MATH Level 537.5%—

Knowledge Qwen3.7 Plus leads

Claude 3 Opus: 24.5 (#267), Qwen3.7 Plus: 54.9 (#51)

BenchmarkClaude 3 OpusQwen3.7 Plus
GPQA Diamond47.2%87.9%
LMArena Expert12231467
SimpleQA Verified12.6%—
Confabulations22.7%—
MMLU84.6%—

Multimodal Qwen3.7 Plus leads

Claude 3 Opus: 27.1 (#116), Qwen3.7 Plus: 41.8 (#33)

BenchmarkClaude 3 OpusQwen3.7 Plus
LMArena Vision10231279
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

Claude 3 Opus: 41.4 (#207), Qwen3.7 Plus: 54.8 (#38)

BenchmarkClaude 3 OpusQwen3.7 Plus
LMArena Non-English12581445
LMArena Chinese12481510
LMArena French12751473
LMArena German12581471
LMArena Japanese12041413
LMArena Korean11871415
LMArena Russian12801457
LMArena Spanish12461457

Instruction Following Qwen3.7 Plus leads

Claude 3 Opus: 64.1 (#228), Qwen3.7 Plus: 75.8 (#52)

BenchmarkClaude 3 OpusQwen3.7 Plus
LMArena Instruction Following12481440
LiveBench Instruction Following63.9%—

Long Context Qwen3.7 Plus leads

Claude 3 Opus: 38.2 (#202), Qwen3.7 Plus: 44.5 (#65)

BenchmarkClaude 3 OpusQwen3.7 Plus
LMArena Longer Query12591455

Writing & Preference Qwen3.7 Plus leads

Claude 3 Opus: 47.2 (#213), Qwen3.7 Plus: 64.3 (#56)

BenchmarkClaude 3 OpusQwen3.7 Plus
LMArena Text12621455
LMArena Creative Writing12351439
LMArena Multi-Turn12751460
LiveBench Language50.4%—

Frequently asked questions

Is Claude 3 Opus better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 29.5 on the Noometry Index.

Is Claude 3 Opus or Qwen3.7 Plus better for coding?

Qwen3.7 Plus scores higher on coding benchmarks: 36.6 versus 32.9 in the Noometry coding category.

How many benchmarks do Claude 3 Opus and Qwen3.7 Plus share?

24 benchmarks have published results for both models. Claude 3 Opus has 46 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper