Model comparison

Claude 2.1 vs Qwen3-Coder 480B-A35B Instruct

Qwen3-Coder 480B-A35B Instruct is the stronger model overall, scoring 38.1 to 25.2 on the Noometry Index.

Last verified . 1 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

Summary

  • They share 1 benchmark with published results for both. Claude 2.1 scores higher in 0 categories and Qwen3-Coder 480B-A35B Instruct in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3-Coder 480B-A35B Instruct leads 37.6 to 10.2.
  • The biggest single-benchmark swing is WeirdML: 7.1% for Claude 2.1 and 41.2% for Qwen3-Coder 480B-A35B Instruct.
  • Qwen3-Coder 480B-A35B Instruct has downloadable open weights; the other is API-only.

Side by side

Claude 2.1 and Qwen3-Coder 480B-A35B Instruct specifications
Claude 2.1Qwen3-Coder 480B-A35B Instruct
ProviderAnthropicAlibaba (Qwen)
Noometry Index25.238.1
Released2023-11-212025-04
WeightsProprietaryOpen
Context window—262K
Max output—66K
Input $ / M tokens—$1.50
Output $ / M tokens—$7.50
Results tracked725

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3-Coder 480B-A35B Instruct leads

Claude 2.1: 26.2 (#327), Qwen3-Coder 480B-A35B Instruct: 35.5 (#223)

Coding benchmarks
BenchmarkClaude 2.1Qwen3-Coder 480B-A35B Instruct
WeirdML7.1%41.2%
SWE-bench Verified (bash only)—55.4%
LMArena WebDev—1275
GSO—4.9%
LMArena Coding—1412
ALE-Bench—461.45
AlgoTune—1.44

Agentic & Tool Use Not comparable

Claude 2.1: —, Qwen3-Coder 480B-A35B Instruct: 23.9 (#123)

Agentic & Tool Use benchmarks
BenchmarkClaude 2.1Qwen3-Coder 480B-A35B Instruct
Terminal-Bench—27.2%

Reasoning Qwen3-Coder 480B-A35B Instruct leads

Claude 2.1: 21.4 (#221), Qwen3-Coder 480B-A35B Instruct: 25.5 (#149)

Reasoning benchmarks
BenchmarkClaude 2.1Qwen3-Coder 480B-A35B Instruct
Kagi LLM Benchmark—49.5%
LMArena Hard Prompts—1372
DTBench51%—
Epoch Capabilities Index119.27—
ForecastBench54.2—

Math Qwen3-Coder 480B-A35B Instruct leads

Claude 2.1: 10.2 (#315), Qwen3-Coder 480B-A35B Instruct: 37.6 (#150)

Math benchmarks
BenchmarkClaude 2.1Qwen3-Coder 480B-A35B Instruct
OTIS Mock AIME 2024-20251.9%—
LMArena Math—1365

Knowledge Qwen3-Coder 480B-A35B Instruct leads

Claude 2.1: 15.4 (#292), Qwen3-Coder 480B-A35B Instruct: 37.0 (#162)

Knowledge benchmarks
BenchmarkClaude 2.1Qwen3-Coder 480B-A35B Instruct
GPQA Diamond33%—
LMArena Expert—1338
MMLU73.5%—

Multilingual Not comparable

Claude 2.1: —, Qwen3-Coder 480B-A35B Instruct: 47.7 (#148)

Multilingual benchmarks
BenchmarkClaude 2.1Qwen3-Coder 480B-A35B Instruct
LMArena Non-English—1346
LMArena Chinese—1357
LMArena French—1398
LMArena German—1325
LMArena Japanese—1310
LMArena Korean—1305
LMArena Russian—1366
LMArena Spanish—1360

Instruction Following Not comparable

Claude 2.1: —, Qwen3-Coder 480B-A35B Instruct: 71.6 (#147)

Instruction Following benchmarks
BenchmarkClaude 2.1Qwen3-Coder 480B-A35B Instruct
LMArena Instruction Following—1355

Long Context Not comparable

Claude 2.1: —, Qwen3-Coder 480B-A35B Instruct: 42.0 (#131)

Long Context benchmarks
BenchmarkClaude 2.1Qwen3-Coder 480B-A35B Instruct
LMArena Longer Query—1378

Writing & Preference Not comparable

Claude 2.1: —, Qwen3-Coder 480B-A35B Instruct: 55.3 (#147)

Writing & Preference benchmarks
BenchmarkClaude 2.1Qwen3-Coder 480B-A35B Instruct
LMArena Text—1357
LMArena Creative Writing—1333
LMArena Multi-Turn—1365

Frequently asked questions

Is Claude 2.1 better than Qwen3-Coder 480B-A35B Instruct?

Qwen3-Coder 480B-A35B Instruct is the stronger model overall, scoring 38.1 to 25.2 on the Noometry Index.

Is Claude 2.1 or Qwen3-Coder 480B-A35B Instruct better for coding?

Qwen3-Coder 480B-A35B Instruct scores higher on coding benchmarks: 35.5 versus 26.2 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Qwen3-Coder 480B-A35B Instruct share?

1 benchmark has published results for both models. Claude 2.1 has 7 scored results on Noometry and Qwen3-Coder 480B-A35B Instruct has 25.

Related comparisons

Go deeper