Model comparison
Kimi K2 (Jul 2025) vs Qwen3.5 Max Preview
Qwen3.5 Max Preview is the stronger model overall, scoring 45.3 to 41.2 on the Noometry Index.
Last verified . 17 shared benchmarks.
Alibaba (Qwen)Summary
- They share 17 benchmarks with published results for both. Kimi K2 (Jul 2025) scores higher in 1 category and Qwen3.5 Max Preview in 7 categories; 8 gaps are clear of the uncertainty.
- The widest gap is in reasoning, where Qwen3.5 Max Preview leads 30.8 to 23.3.
- Kimi K2 (Jul 2025) has downloadable open weights; the other is API-only.
Side by side
| Kimi K2 (Jul 2025) | Qwen3.5 Max Preview | |
|---|---|---|
| Provider | Moonshot AI | Alibaba (Qwen) |
| Noometry Index | 41.2 | 45.3 |
| Released | 2025-07-12 | — |
| Weights | Open | Proprietary |
| Context window | 262K | — |
| Max output | 262K | — |
| Input $ / M tokens | $0.57 | — |
| Output $ / M tokens | $2.30 | — |
| Results tracked | 42 | 17 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Qwen3.5 Max Preview leads
Kimi K2 (Jul 2025): 42.4 (#102), Qwen3.5 Max Preview: 44.0 (#77)
| Benchmark | Kimi K2 (Jul 2025) | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Coding | 1399 | 1487 |
| SWE-bench Verified (bash only) | 63.4% | — |
| Aider Polyglot | 59.1% | — |
| GSO | 4.9% | — |
| WeirdML | 42.8% | — |
| ALE-Bench | 597.5 | — |
Agentic & Tool Use Not comparable
Kimi K2 (Jul 2025): 32.4 (#64), Qwen3.5 Max Preview: —
| Benchmark | Kimi K2 (Jul 2025) | Qwen3.5 Max Preview |
|---|---|---|
| Terminal-Bench | 35.7% | — |
| Berkeley Function Calling Leaderboard | 59.1% | — |
| METR Time Horizons | 59.2% | — |
Reasoning Qwen3.5 Max Preview leads
Kimi K2 (Jul 2025): 23.3 (#179), Qwen3.5 Max Preview: 30.8 (#84)
| Benchmark | Kimi K2 (Jul 2025) | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Hard Prompts | 1384 | 1483 |
| SimpleBench | 26.3% | — |
| Kagi LLM Benchmark | 64.4% | — |
| Epoch Capabilities Index | 146.01 | — |
| ForecastBench | 60.2 | — |
Math Kimi K2 (Jul 2025) leads
Kimi K2 (Jul 2025): 42.7 (#83), Qwen3.5 Max Preview: 40.1 (#94)
| Benchmark | Kimi K2 (Jul 2025) | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Math | 1397 | 1474 |
| Omni-MATH | 65.4% | — |
| FrontierMath (Feb 2025 set) | 21.4% | — |
| FrontierMath Tier 4 (v1) | 0% | — |
Knowledge Qwen3.5 Max Preview leads
Kimi K2 (Jul 2025): 37.3 (#157), Qwen3.5 Max Preview: 41.8 (#107)
| Benchmark | Kimi K2 (Jul 2025) | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Expert | 1365 | 1489 |
| MMLU-Pro | 81.9% | — |
| Confabulations | 20.4% | — |
| Vectara Hallucination Rate | 17.9% | — |
| GPQA (HELM) | 65.3% | — |
Multilingual Qwen3.5 Max Preview leads
Kimi K2 (Jul 2025): 49.6 (#130), Qwen3.5 Max Preview: 56.2 (#22)
| Benchmark | Kimi K2 (Jul 2025) | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Non-English | 1372 | 1465 |
| LMArena Chinese | 1415 | 1534 |
| LMArena French | 1379 | 1484 |
| LMArena German | 1387 | 1487 |
| LMArena Japanese | 1349 | 1495 |
| LMArena Korean | 1325 | 1438 |
| LMArena Russian | 1385 | 1471 |
| LMArena Spanish | 1386 | 1470 |
Instruction Following Qwen3.5 Max Preview leads
Kimi K2 (Jul 2025): 71.1 (#156), Qwen3.5 Max Preview: 77.0 (#31)
| Benchmark | Kimi K2 (Jul 2025) | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Instruction Following | 1348 | 1467 |
| IFEval | 85% | — |
Long Context Qwen3.5 Max Preview leads
Kimi K2 (Jul 2025): 41.2 (#145), Qwen3.5 Max Preview: 45.2 (#45)
| Benchmark | Kimi K2 (Jul 2025) | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Longer Query | 1353 | 1476 |
| Fiction.LiveBench | 66.7% | — |
| CL-bench | 17.6% | — |
Writing & Preference Qwen3.5 Max Preview leads
Kimi K2 (Jul 2025): 62.3 (#78), Qwen3.5 Max Preview: 66.0 (#41)
| Benchmark | Kimi K2 (Jul 2025) | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Text | 1380 | 1470 |
| LMArena Creative Writing | 1350 | 1464 |
| LMArena Multi-Turn | 1371 | 1478 |
| Short-Story Creative Writing | 85.6% | — |
| EQ-Bench Creative Writing | 1666 | — |
| WildBench | 86.2% | — |
Frequently asked questions
Is Kimi K2 (Jul 2025) better than Qwen3.5 Max Preview?
Qwen3.5 Max Preview is the stronger model overall, scoring 45.3 to 41.2 on the Noometry Index.
Is Kimi K2 (Jul 2025) or Qwen3.5 Max Preview better for coding?
Qwen3.5 Max Preview scores higher on coding benchmarks: 44.0 versus 42.4 in the Noometry coding category.
How many benchmarks do Kimi K2 (Jul 2025) and Qwen3.5 Max Preview share?
17 benchmarks have published results for both models. Kimi K2 (Jul 2025) has 42 scored results on Noometry and Qwen3.5 Max Preview has 17.