Noometry

Model comparison

Claude Opus 4.1 vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 40.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

Claude Opus 4.1 Anthropic

40.8

Rank #136 Confirmed

Qwen3.5 Max Preview Alibaba (Qwen)

44.7

Rank #72 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Claude Opus 4.1 scores higher in 3 categories and Qwen3.5 Max Preview in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.5 Max Preview leads 37.3 to 22.0.

Side by side

Claude Opus 4.1Qwen3.5 Max Preview
ProviderAnthropicAlibaba (Qwen)
Noometry Index40.844.7
Released2025-08-05—
WeightsProprietaryProprietary
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked4817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Claude Opus 4.1: 44.3 (#69), Qwen3.5 Max Preview: 43.4 (#79)

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
LMArena Coding14791488
SWE-bench Verified73.3%—
LMArena WebDev1390—
WeirdML45.9%—
ALE-Bench674.77—
AlgoTune1.34—

Agentic & Tool Use Not comparable

Claude Opus 4.1: 34.8 (#38), Qwen3.5 Max Preview: —

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
Terminal-Bench38%—
GDPval43.6%—
Cybench42%—
DeepResearch Bench48.3%—
LMArena Search1148—
METR Time Horizons66.8%—

Reasoning Claude Opus 4.1 leads

Claude Opus 4.1: 31.6 (#70), Qwen3.5 Max Preview: 29.6 (#81)

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
LMArena Hard Prompts14431483
SimpleBench60%—
Chess Puzzles7%—
EnigmaEval7.2%—
EBR-Bench7.9%—
Mystery Game Puzzles21%—
DTBench80%—
LMCA37.1%—
Epoch Capabilities Index144.11—
ForecastBench62—

Math Qwen3.5 Max Preview leads

Claude Opus 4.1: 22.0 (#267), Qwen3.5 Max Preview: 37.3 (#99)

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
LMArena Math14301473
FrontierMath (Tiers 1-3)12.6%—
FrontierMath Tier 42.4%—
OTIS Mock AIME 2024-202568.9%—
FrontierMath (Feb 2025 set)7.2%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Too close to call

Claude Opus 4.1: 41.9 (#93), Qwen3.5 Max Preview: 41.1 (#104)

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
LMArena Expert14391489
GPQA Diamond77.3%—
Humanity's Last Exam11.5%—
Confabulations17.1%—
Vectara Hallucination Rate11.8%—

Multimodal Not comparable

Claude Opus 4.1: 26.2 (#114), Qwen3.5 Max Preview: —

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
VPCT35%—

Multilingual Qwen3.5 Max Preview leads

Claude Opus 4.1: 52.1 (#90), Qwen3.5 Max Preview: 56.4 (#21)

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
LMArena Non-English14051465
LMArena Chinese14271534
LMArena French14321483
LMArena German14121487
LMArena Japanese13781497
LMArena Korean13811438
LMArena Russian14211472
LMArena Spanish14481470

Instruction Following Qwen3.5 Max Preview leads

Claude Opus 4.1: 75.8 (#53), Qwen3.5 Max Preview: 77.2 (#28)

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
LMArena Instruction Following14361467

Long Context Too close to call

Claude Opus 4.1: 44.5 (#60), Qwen3.5 Max Preview: 45.2 (#44)

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
LMArena Longer Query14551477

Writing & Preference Qwen3.5 Max Preview leads

Claude Opus 4.1: 62.6 (#70), Qwen3.5 Max Preview: 66.1 (#39)

BenchmarkClaude Opus 4.1Qwen3.5 Max Preview
LMArena Text14191471
LMArena Creative Writing14121464
LMArena Multi-Turn14441478
Short-Story Creative Writing84.7%—

Frequently asked questions

Is Claude Opus 4.1 better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 40.8 on the Noometry Index.

Is Claude Opus 4.1 or Qwen3.5 Max Preview better for coding?

They score almost the same on coding (44.3 vs 43.4); test both on your own repository before choosing.

How many benchmarks do Claude Opus 4.1 and Qwen3.5 Max Preview share?

17 benchmarks have published results for both models. Claude Opus 4.1 has 48 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper