Noometry

Model comparison

Claude Opus 4.1 vs Qwen1.5-14B

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 32.7 on the Noometry Index.

Last verified . 16 shared benchmarks.

Claude Opus 4.1 Anthropic

41.0

Rank #142 Confirmed

Qwen1.5-14B Alibaba (Qwen)

32.7

Rank #253 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Claude Opus 4.1 scores higher in 7 categories and Qwen1.5-14B in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Claude Opus 4.1 leads 62.4 to 33.6.
  • Qwen1.5-14B has downloadable open weights; the other is API-only.

Side by side

Claude Opus 4.1Qwen1.5-14B
ProviderAnthropicAlibaba (Qwen)
Noometry Index41.032.7
Released2025-08-052024-02-04
WeightsProprietaryOpen
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked4817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.1 leads

Claude Opus 4.1: 44.4 (#73), Qwen1.5-14B: 33.1 (#263)

BenchmarkClaude Opus 4.1Qwen1.5-14B
LMArena Coding14791138
SWE-bench Verified73.3%—
LMArena WebDev1390—
WeirdML45.9%—
ALE-Bench674.77—
AlgoTune1.34—

Agentic & Tool Use Not comparable

Claude Opus 4.1: 35.0 (#41), Qwen1.5-14B: —

BenchmarkClaude Opus 4.1Qwen1.5-14B
Terminal-Bench38%—
GDPval43.6%—
Cybench42%—
DeepResearch Bench48.3%—
LMArena Search1148—
METR Time Horizons66.8%—

Reasoning Claude Opus 4.1 leads

Claude Opus 4.1: 32.2 (#76), Qwen1.5-14B: 21.4 (#223)

BenchmarkClaude Opus 4.1Qwen1.5-14B
LMArena Hard Prompts14431113
SimpleBench60%—
Chess Puzzles7%—
EnigmaEval7.2%—
EBR-Bench7.9%—
Mystery Game Puzzles21%—
DTBench80%—
LMCA37.1%—
Epoch Capabilities Index144.12—
ForecastBench62—

Math Qwen1.5-14B leads

Claude Opus 4.1: 22.3 (#277), Qwen1.5-14B: 32.4 (#215)

BenchmarkClaude Opus 4.1Qwen1.5-14B
LMArena Math14311125
FrontierMath (Tiers 1-3)12.6%—
FrontierMath Tier 42.4%—
OTIS Mock AIME 2024-202568.9%—
FrontierMath (Feb 2025 set)7.2%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Claude Opus 4.1 leads

Claude Opus 4.1: 42.0 (#101), Qwen1.5-14B: 29.8 (#232)

BenchmarkClaude Opus 4.1Qwen1.5-14B
LMArena Expert14391094
GPQA Diamond77.3%—
Humanity's Last Exam11.5%—
Confabulations17.1%—
Vectara Hallucination Rate11.8%—
MMLU—68.6%

Multimodal Not comparable

Claude Opus 4.1: 26.8 (#119), Qwen1.5-14B: —

BenchmarkClaude Opus 4.1Qwen1.5-14B
VPCT35%—

Multilingual Claude Opus 4.1 leads

Claude Opus 4.1: 52.0 (#95), Qwen1.5-14B: 30.7 (#262)

BenchmarkClaude Opus 4.1Qwen1.5-14B
LMArena Non-English14051095
LMArena Chinese14271147
LMArena French14311116
LMArena German14131043
LMArena Japanese13781019
LMArena Russian14221046
LMArena Spanish14481085
LMArena Korean1380—

Instruction Following Claude Opus 4.1 leads

Claude Opus 4.1: 75.6 (#58), Qwen1.5-14B: 56.8 (#271)

BenchmarkClaude Opus 4.1Qwen1.5-14B
LMArena Instruction Following14351102

Long Context Claude Opus 4.1 leads

Claude Opus 4.1: 44.5 (#63), Qwen1.5-14B: 33.7 (#257)

BenchmarkClaude Opus 4.1Qwen1.5-14B
LMArena Longer Query14551113

Writing & Preference Claude Opus 4.1 leads

Claude Opus 4.1: 62.4 (#74), Qwen1.5-14B: 33.6 (#276)

BenchmarkClaude Opus 4.1Qwen1.5-14B
LMArena Text14191128
LMArena Creative Writing14121091
LMArena Multi-Turn14441110
Short-Story Creative Writing84.7%—

Frequently asked questions

Is Claude Opus 4.1 better than Qwen1.5-14B?

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 32.7 on the Noometry Index.

Is Claude Opus 4.1 or Qwen1.5-14B better for coding?

Claude Opus 4.1 scores higher on coding benchmarks: 44.4 versus 33.1 in the Noometry coding category.

How many benchmarks do Claude Opus 4.1 and Qwen1.5-14B share?

16 benchmarks have published results for both models. Claude Opus 4.1 has 48 scored results on Noometry and Qwen1.5-14B has 17.

Related comparisons

Go deeper