Noometry

Model comparison

Claude 3 Sonnet vs Qwen3.5-9B

Qwen3.5-9B is the stronger model overall, scoring 33.3 to 28.8 on the Noometry Index.

Last verified . 4 shared benchmarks.

Claude 3 Sonnet Anthropic

28.8

Rank #311 Confirmed

Qwen3.5-9B Alibaba (Qwen)

33.3

Rank #235 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude 3 Sonnet scores higher in 0 categories and Qwen3.5-9B in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.5-9B leads 46.0 to 21.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 2.5% for Claude 3 Sonnet and 61.7% for Qwen3.5-9B.
  • Qwen3.5-9B has downloadable open weights; the other is API-only.

Side by side

Claude 3 SonnetQwen3.5-9B
ProviderAnthropicAlibaba (Qwen)
Noometry Index28.833.3
Released2024-02-292026-02-23
WeightsProprietaryOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.15
Results tracked3010

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5-9B leads

Claude 3 Sonnet: 29.2 (#296), Qwen3.5-9B: 35.3 (#213)

BenchmarkClaude 3 SonnetQwen3.5-9B
SciCode—27.5%
WeirdML10.2%—
BigCodeBench Instruct42.7%—
LMArena Coding1223—
BigCodeBench Complete53.8%—
HumanEval+64%—
MBPP+69.3%—

Agentic & Tool Use Not comparable

Claude 3 Sonnet: —, Qwen3.5-9B: 14.4 (#143)

BenchmarkClaude 3 SonnetQwen3.5-9B
Terminal-Bench—9.2%

Reasoning Qwen3.5-9B leads

Claude 3 Sonnet: 19.7 (#232), Qwen3.5-9B: 22.5 (#178)

BenchmarkClaude 3 SonnetQwen3.5-9B
DTBench53.6%71.2%
Epoch Capabilities Index120.69139.45
CritPt—0.3%
Chess Puzzles—12%
LMArena Hard Prompts1197—
LMCA—24.5%
WinoGrande75.1%—

Math Qwen3.5-9B leads

Claude 3 Sonnet: 10.0 (#305), Qwen3.5-9B: 33.5 (#174)

BenchmarkClaude 3 SonnetQwen3.5-9B
OTIS Mock AIME 2024-20252.5%61.7%
MathArena Final-Answer Competitions—48.5%
LMArena Math1213—
MATH Level 518.2%—

Knowledge Qwen3.5-9B leads

Claude 3 Sonnet: 21.1 (#271), Qwen3.5-9B: 46.0 (#77)

BenchmarkClaude 3 SonnetQwen3.5-9B
GPQA Diamond40.6%79%
LMArena Expert1173—
MMLU75.9%—

Multimodal Not comparable

Claude 3 Sonnet: 24.7 (#120), Qwen3.5-9B: —

BenchmarkClaude 3 SonnetQwen3.5-9B
LMArena Vision984—

Multilingual Not comparable

Claude 3 Sonnet: 38.0 (#229), Qwen3.5-9B: —

BenchmarkClaude 3 SonnetQwen3.5-9B
LMArena Non-English1205—
LMArena Chinese1188—
LMArena French1228—
LMArena German1204—
LMArena Japanese1131—
LMArena Korean1128—
LMArena Russian1227—
LMArena Spanish1204—

Instruction Following Not comparable

Claude 3 Sonnet: 63.1 (#230), Qwen3.5-9B: —

BenchmarkClaude 3 SonnetQwen3.5-9B
LMArena Instruction Following1200—

Long Context Not comparable

Claude 3 Sonnet: 36.7 (#223), Qwen3.5-9B: —

BenchmarkClaude 3 SonnetQwen3.5-9B
LMArena Longer Query1211—

Writing & Preference Not comparable

Claude 3 Sonnet: 42.3 (#233), Qwen3.5-9B: —

BenchmarkClaude 3 SonnetQwen3.5-9B
LMArena Text1218—
LMArena Creative Writing1186—
LMArena Multi-Turn1227—

Frequently asked questions

Is Claude 3 Sonnet better than Qwen3.5-9B?

Qwen3.5-9B is the stronger model overall, scoring 33.3 to 28.8 on the Noometry Index.

Is Claude 3 Sonnet or Qwen3.5-9B better for coding?

Qwen3.5-9B scores higher on coding benchmarks: 35.3 versus 29.2 in the Noometry coding category.

How many benchmarks do Claude 3 Sonnet and Qwen3.5-9B share?

4 benchmarks have published results for both models. Claude 3 Sonnet has 30 scored results on Noometry and Qwen3.5-9B has 10.

Related comparisons

Go deeper