Noometry

Model comparison

Claude Opus 4 vs Qwen2-72B

Claude Opus 4 is the stronger model overall, scoring 43.1 to 30.0 on the Noometry Index.

Last verified . 22 shared benchmarks.

Claude Opus 4 Anthropic

43.1

Rank #100 Confirmed

Qwen2-72B Alibaba (Qwen)

30.0

Rank #300 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Claude Opus 4 scores higher in 9 categories and Qwen2-72B in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude Opus 4 leads 44.0 to 21.2.
  • The biggest single-benchmark swing is MATH Level 5: 85% for Claude Opus 4 and 39.1% for Qwen2-72B.
  • Qwen2-72B has downloadable open weights; the other is API-only.

Side by side

Claude Opus 4Qwen2-72B
ProviderAnthropicAlibaba (Qwen)
Noometry Index43.130.0
Released2025-05-222024-06-07
WeightsProprietaryOpen
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked5626

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4 leads

Claude Opus 4: 47.2 (#62), Qwen2-72B: 29.1 (#310)

BenchmarkClaude Opus 4Qwen2-72B
WeirdML43.7%11.3%
LMArena Coding14421196
SWE-bench Verified70.7%—
SWE-bench Verified (bash only)67.6%—
Aider Polyglot72%—
GSO6.9%—
BigCodeBench Instruct—38.5%
BigCodeBench Complete—54%
AlgoTune1.33—

Agentic & Tool Use Claude Opus 4 leads

Claude Opus 4: 34.8 (#42), Qwen2-72B: 17.0 (#146)

BenchmarkClaude Opus 4Qwen2-72B
METR Time Horizons63.9%29.9%
TheAgentCompany—1.1%
Cybench38%—
DeepResearch Bench46.8%—
LMArena Search1127—

Reasoning Claude Opus 4 leads

Claude Opus 4: 27.3 (#121), Qwen2-72B: 23.2 (#181)

BenchmarkClaude Opus 4Qwen2-72B
LMArena Hard Prompts13991191
Epoch Capabilities Index142.67125.28
ARC-AGI-28.6%—
SimpleBench58.8%—
Kagi LLM Benchmark74.3%—
ARC-AGI-135.7%—
CritPt0.3%—
EnigmaEval5.6%—
DTBench81.6%—
LMCA37.4%—
ForecastBench61.1—

Math Claude Opus 4 leads

Claude Opus 4: 42.0 (#86), Qwen2-72B: 30.2 (#236)

BenchmarkClaude Opus 4Qwen2-72B
LMArena Math13901235
MATH Level 585%39.1%
OTIS Mock AIME 2024-202564.4%—
Omni-MATH61.6%—
FrontierMath (Feb 2025 set)4.5%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Claude Opus 4 leads

Claude Opus 4: 44.0 (#88), Qwen2-72B: 21.2 (#275)

BenchmarkClaude Opus 4Qwen2-72B
GPQA Diamond76.3%40.8%
LMArena Expert13861171
Humanity's Last Exam10.7%—
MMLU-Pro87.5%—
Confabulations15.9%—
Vectara Hallucination Rate12%—
GPQA (HELM)70.8%—
MMLU—82.4%

Multimodal Not comparable

Claude Opus 4: 31.5 (#106), Qwen2-72B: —

BenchmarkClaude Opus 4Qwen2-72B
LMArena Vision1192—
GeoBench49%—
VPCT38%—

Multilingual Claude Opus 4 leads

Claude Opus 4: 48.8 (#138), Qwen2-72B: 35.9 (#244)

BenchmarkClaude Opus 4Qwen2-72B
LMArena Non-English13621176
LMArena Chinese13861240
LMArena French13721170
LMArena German13911151
LMArena Japanese13311111
LMArena Korean13211083
LMArena Russian13921169
LMArena Spanish13891169

Instruction Following Claude Opus 4 leads

Claude Opus 4: 77.1 (#28), Qwen2-72B: 61.7 (#241)

BenchmarkClaude Opus 4Qwen2-72B
LMArena Instruction Following14061181
IFEval91.8%—

Long Context Claude Opus 4 leads

Claude Opus 4: 39.6 (#172), Qwen2-72B: 36.1 (#235)

BenchmarkClaude Opus 4Qwen2-72B
LMArena Longer Query14221192
Fiction.LiveBench61.1%—

Writing & Preference Claude Opus 4 leads

Claude Opus 4: 61.2 (#89), Qwen2-72B: 40.8 (#241)

BenchmarkClaude Opus 4Qwen2-72B
LMArena Text13771203
LMArena Creative Writing13871181
LMArena Multi-Turn13961196
Short-Story Creative Writing83.6%—
EQ-Bench Creative Writing1580—
WildBench85.2%—

Frequently asked questions

Is Claude Opus 4 better than Qwen2-72B?

Claude Opus 4 is the stronger model overall, scoring 43.1 to 30.0 on the Noometry Index.

Is Claude Opus 4 or Qwen2-72B better for coding?

Claude Opus 4 scores higher on coding benchmarks: 47.2 versus 29.1 in the Noometry coding category.

How many benchmarks do Claude Opus 4 and Qwen2-72B share?

22 benchmarks have published results for both models. Claude Opus 4 has 56 scored results on Noometry and Qwen2-72B has 26.

Related comparisons

Go deeper