# Claude 3.5 Sonnet vs Qwen Plus

> Qwen Plus is the stronger model overall, scoring 36.7 to 34.4 on the Noometry Index.

- Canonical page: https://noometry.com/compare/claude-3-5-sonnet-vs-qwen-plus
- Last updated: 2026-10-10
- Shared benchmarks: 18

## Summary

- They share 18 benchmarks with published results for both. Claude 3.5 Sonnet scores higher in 3 categories and Qwen Plus in 5 categories; 5 gaps are clear of the uncertainty.
- The widest gap is in reasoning, where Qwen Plus leads 27.6 to 22.5.
- The biggest single-benchmark swing is DTBench: 67.8% for Claude 3.5 Sonnet and 81.1% for Qwen Plus.

## Snapshot

| | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| Provider | Anthropic | Alibaba (Qwen) |
| Noometry Index | 34.4 | 36.7 |
| Rank | 225 | 204 |
| Context | — | 1M |
| Input $/M | — | $0.40 |
| Output $/M | — | $1.20 |
| Weights | Proprietary | Proprietary |

## Coding

- Claude 3.5 Sonnet: 39.5 (#145)
- Qwen Plus: 38.3 (#163)

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| LMArena Coding | 1343 | 1328 |
| Aider Polyglot | 51.6% | — |
| GSO | 4.6% | — |
| WeirdML | 40% | — |
| BigCodeBench Instruct | 46.8% | — |
| LiveBench Coding | 67.1% | — |
| BigCodeBench Complete | 58.6% | — |
| CadEval | 48% | — |
| HumanEval+ | 81.7% | — |
| MBPP+ | 74.3% | — |

## Agentic & Tool Use

- Claude 3.5 Sonnet: 32.1 (#61)
- Qwen Plus: —

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| TheAgentCompany | 24% | — |
| Cybench | 17.5% | — |
| BALROG | 32.6% | — |
| METR Time Horizons | 45.2% | — |

## Reasoning

- Claude 3.5 Sonnet: 22.5 (#176)
- Qwen Plus: 27.6 (#101)

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| LMArena Hard Prompts | 1305 | 1317 |
| DTBench | 67.8% | 81.1% |
| SimpleBench | 41.4% | — |
| Kagi LLM Benchmark | — | 63.3% |
| EnigmaEval | 0.9% | — |
| LiveBench Reasoning | 56.7% | — |
| LiveBench Data Analysis | 55% | — |
| LMCA | — | 24% |
| Epoch Capabilities Index | 133.55 | — |
| ForecastBench | 60.7 | — |
| LiveBench | 59% | — |

## Math

- Claude 3.5 Sonnet: 18.0 (#282)
- Qwen Plus: 22.0 (#266)

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| OTIS Mock AIME 2024-2025 | 8.5% | 17.8% |
| LMArena Math | 1306 | 1326 |
| MATH Level 5 | 56.9% | 65.3% |
| FrontierMath (Feb 2025 set) | 2.1% | 1.7% |
| Omni-MATH | 27.6% | — |
| LiveBench Math | 52.3% | — |
| FrontierMath Tier 4 (v1) | 0% | — |

## Knowledge

- Claude 3.5 Sonnet: 28.5 (#236)
- Qwen Plus: 27.4 (#245)

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| GPQA Diamond | 55.3% | 48.1% |
| LMArena Expert | 1264 | 1328 |
| Humanity's Last Exam | 4.1% | — |
| MMLU-Pro | 77.7% | — |
| Confabulations | 19.9% | — |
| GPQA (HELM) | 56.5% | — |
| MMLU | 87.3% | — |

## Multimodal

- Claude 3.5 Sonnet: 26.0 (#115)
- Qwen Plus: —

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| LMArena Vision | 1125 | — |
| Video-MME | 60% | — |
| GeoBench | 62% | — |
| VPCT | 33% | — |

## Multilingual

- Claude 3.5 Sonnet: 43.4 (#180)
- Qwen Plus: 45.3 (#170)

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| LMArena Non-English | 1283 | 1310 |
| LMArena Chinese | 1271 | 1347 |
| LMArena Japanese | 1234 | 1251 |
| LMArena Russian | 1305 | 1323 |
| LMArena French | 1304 | — |
| LMArena German | 1297 | — |
| LMArena Korean | 1200 | — |
| LMArena Spanish | 1289 | — |

## Instruction Following

- Claude 3.5 Sonnet: 69.0 (#177)
- Qwen Plus: 69.0 (#176)

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| LMArena Instruction Following | 1297 | 1303 |
| LiveBench Instruction Following | 69.3% | — |
| IFEval | 85.5% | — |

## Long Context

- Claude 3.5 Sonnet: 39.9 (#162)
- Qwen Plus: 40.3 (#153)

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| LMArena Longer Query | 1311 | 1325 |

## Writing & Preference

- Claude 3.5 Sonnet: 53.0 (#159)
- Qwen Plus: 52.4 (#171)

| Benchmark | Claude 3.5 Sonnet | Qwen Plus |
|---|---|---|
| LMArena Text | 1298 | 1326 |
| LMArena Creative Writing | 1292 | 1293 |
| LMArena Multi-Turn | 1326 | 1336 |
| Short-Story Creative Writing | 80.3% | — |
| EQ-Bench Creative Writing | 1451 | — |
| WildBench | 79.2% | — |
| LiveBench Language | 53.8% | — |

## FAQ

### Is Claude 3.5 Sonnet better than Qwen Plus?

Qwen Plus is the stronger model overall, scoring 36.7 to 34.4 on the Noometry Index.

### Is Claude 3.5 Sonnet or Qwen Plus better for coding?

Claude 3.5 Sonnet scores higher on coding benchmarks: 39.5 versus 38.3 in the Noometry coding category.

### How many benchmarks do Claude 3.5 Sonnet and Qwen Plus share?

18 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and Qwen Plus has 20.
