Noometry

Model comparison

Kimi K2 (Jul 2025) vs Qwen Max

Kimi K2 (Jul 2025) is the stronger model overall, scoring 41.2 to 34.7 on the Noometry Index.

Last verified . 20 shared benchmarks.

Kimi K2 (Jul 2025) Moonshot AI

41.2

Rank #140 Confirmed

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Kimi K2 (Jul 2025) scores higher in 7 categories and Qwen Max in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K2 (Jul 2025) leads 42.7 to 22.3.
  • The biggest single-benchmark swing is Aider Polyglot: 59.1% for Kimi K2 (Jul 2025) and 21.8% for Qwen Max.
  • Kimi K2 (Jul 2025) is cheaper at $0.57 / $2.30 per million input/output tokens, against $1.60 / $6.40 for Qwen Max.
  • Kimi K2 (Jul 2025) accepts more context: 262K tokens versus 33K.
  • Kimi K2 (Jul 2025) has downloadable open weights; the other is API-only.

Side by side

Kimi K2 (Jul 2025)Qwen Max
ProviderMoonshot AIAlibaba (Qwen)
Noometry Index41.234.7
Released2025-07-122024-04-03
WeightsOpenProprietary
Context window262K33K
Max output262K8K
Input $ / M tokens$0.57$1.60
Output $ / M tokens$2.30$6.40
Results tracked4223

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 42.4 (#102), Qwen Max: 30.7 (#292)

BenchmarkKimi K2 (Jul 2025)Qwen Max
Aider Polyglot59.1%21.8%
LMArena Coding13991288
SWE-bench Verified (bash only)63.4%—
GSO4.9%—
WeirdML42.8%—
ALE-Bench597.5—

Agentic & Tool Use Not comparable

Kimi K2 (Jul 2025): 32.4 (#64), Qwen Max: —

BenchmarkKimi K2 (Jul 2025)Qwen Max
Terminal-Bench35.7%—
Berkeley Function Calling Leaderboard59.1%—
METR Time Horizons59.2%—

Reasoning Qwen Max leads

Kimi K2 (Jul 2025): 23.3 (#179), Qwen Max: 25.1 (#151)

BenchmarkKimi K2 (Jul 2025)Qwen Max
LMArena Hard Prompts13841269
SimpleBench26.3%—
Kagi LLM Benchmark64.4%—
Epoch Capabilities Index146.01—
ForecastBench60.2—

Math Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 42.7 (#83), Qwen Max: 22.3 (#276)

BenchmarkKimi K2 (Jul 2025)Qwen Max
LMArena Math13971275
FrontierMath (Feb 2025 set)21.4%1%
OTIS Mock AIME 2024-2025—16.1%
Omni-MATH65.4%—
MATH Level 5—67.2%
FrontierMath Tier 4 (v1)0%—

Knowledge Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 37.3 (#157), Qwen Max: 30.3 (#228)

BenchmarkKimi K2 (Jul 2025)Qwen Max
LMArena Expert13651248
GPQA Diamond—56.1%
MMLU-Pro81.9%—
Confabulations20.4%—
Vectara Hallucination Rate17.9%—
GPQA (HELM)65.3%—

Multilingual Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 49.6 (#130), Qwen Max: 41.8 (#202)

BenchmarkKimi K2 (Jul 2025)Qwen Max
LMArena Non-English13721263
LMArena Chinese14151254
LMArena French13791330
LMArena German13871254
LMArena Japanese13491205
LMArena Korean13251142
LMArena Russian13851274
LMArena Spanish13861290

Instruction Following Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 71.1 (#156), Qwen Max: 66.5 (#208)

BenchmarkKimi K2 (Jul 2025)Qwen Max
LMArena Instruction Following13481262
IFEval85%—

Long Context Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 41.2 (#145), Qwen Max: 39.4 (#180)

BenchmarkKimi K2 (Jul 2025)Qwen Max
Fiction.LiveBench66.7%66.7%
LMArena Longer Query13531288
CL-bench17.6%—

Writing & Preference Kimi K2 (Jul 2025) leads

Kimi K2 (Jul 2025): 62.3 (#78), Qwen Max: 47.8 (#205)

BenchmarkKimi K2 (Jul 2025)Qwen Max
LMArena Text13801282
LMArena Creative Writing13501248
LMArena Multi-Turn13711277
Short-Story Creative Writing85.6%—
EQ-Bench Creative Writing1666—
WildBench86.2%—

Frequently asked questions

Is Kimi K2 (Jul 2025) better than Qwen Max?

Kimi K2 (Jul 2025) is the stronger model overall, scoring 41.2 to 34.7 on the Noometry Index.

Which is cheaper, Kimi K2 (Jul 2025) or Qwen Max?

Kimi K2 (Jul 2025) is cheaper. It lists at $0.57 per million input tokens and $2.30 per million output tokens; Qwen Max lists at $1.60 and $6.40.

Is Kimi K2 (Jul 2025) or Qwen Max better for coding?

Kimi K2 (Jul 2025) scores higher on coding benchmarks: 42.4 versus 30.7 in the Noometry coding category.

Which has the bigger context window?

Kimi K2 (Jul 2025) does, with 262K tokens against 33K.

How many benchmarks do Kimi K2 (Jul 2025) and Qwen Max share?

20 benchmarks have published results for both models. Kimi K2 (Jul 2025) has 42 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper