Noometry

Model comparison

Kimi K2.5 vs Qwen Max

Kimi K2.5 is the stronger model overall, scoring 48.1 to 34.7 on the Noometry Index.

Last verified . 21 shared benchmarks.

Kimi K2.5 Moonshot AI

48.1

Rank #57 Confirmed

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Kimi K2.5 scores higher in 8 categories and Qwen Max in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K2.5 leads 51.8 to 22.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 92.2% for Kimi K2.5 and 16.1% for Qwen Max.
  • Kimi K2.5 is cheaper at $0.45 / $2.25 per million input/output tokens, against $1.60 / $6.40 for Qwen Max.
  • Kimi K2.5 accepts more context: 262K tokens versus 33K.
  • Kimi K2.5 has downloadable open weights; the other is API-only.

Side by side

Kimi K2.5Qwen Max
ProviderMoonshot AIAlibaba (Qwen)
Noometry Index48.134.7
Released2026-01-272024-04-03
WeightsOpenProprietary
Context window262K33K
Max output262K8K
Input $ / M tokens$0.45$1.60
Output $ / M tokens$2.25$6.40
Results tracked5123

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 leads

Kimi K2.5: 48.8 (#53), Qwen Max: 30.7 (#292)

BenchmarkKimi K2.5Qwen Max
LMArena Coding14741288
SWE-bench Verified73.8%—
SWE-bench Verified (bash only)70.8%—
Aider Polyglot—21.8%
LMArena WebDev1437—
SWE-bench Multilingual67.3%—
SciCode49%—
WeirdML45.6%—
ALE-Bench821.65—

Agentic & Tool Use Not comparable

Kimi K2.5: 34.2 (#48), Qwen Max: —

BenchmarkKimi K2.5Qwen Max
Terminal-Bench43.2%—
OSWorld63.3%—
Vending-Bench 21,198—

Reasoning Kimi K2.5 leads

Kimi K2.5: 31.2 (#80), Qwen Max: 25.1 (#151)

BenchmarkKimi K2.5Qwen Max
LMArena Hard Prompts14531269
ARC-AGI-211.8%—
SimpleBench46.8%—
Kagi LLM Benchmark78.5%—
NYT Connections (extended)69.9%—
ARC-AGI-165.3%—
CritPt3.1%—
Chess Puzzles12%—
EnigmaEval3.4%—
Thematic Generalization69.4%—
Epoch Capabilities Index148.03—

Math Kimi K2.5 leads

Kimi K2.5: 51.8 (#53), Qwen Max: 22.3 (#276)

BenchmarkKimi K2.5Qwen Max
OTIS Mock AIME 2024-202592.2%16.1%
LMArena Math14701275
FrontierMath (Feb 2025 set)27.9%1%
MathArena Final-Answer Competitions62.3%—
MATH Level 5—67.2%
FrontierMath Tier 4 (v1)4.2%—

Knowledge Kimi K2.5 leads

Kimi K2.5: 53.6 (#56), Qwen Max: 30.3 (#228)

BenchmarkKimi K2.5Qwen Max
GPQA Diamond87.6%56.1%
LMArena Expert14661248
Humanity's Last Exam24.4%—
SimpleQA Verified34.3%—
Vectara Hallucination Rate14.2%—

Multimodal Not comparable

Kimi K2.5: 41.1 (#39), Qwen Max: —

BenchmarkKimi K2.5Qwen Max
LMArena Vision1269—
LMArena Document1430—

Multilingual Kimi K2.5 leads

Kimi K2.5: 53.9 (#53), Qwen Max: 41.8 (#202)

BenchmarkKimi K2.5Qwen Max
LMArena Non-English14331263
LMArena Chinese14951254
LMArena French14541330
LMArena German14411254
LMArena Japanese14211205
LMArena Korean14101142
LMArena Russian14351274
LMArena Spanish14501290

Instruction Following Kimi K2.5 leads

Kimi K2.5: 75.3 (#64), Qwen Max: 66.5 (#208)

BenchmarkKimi K2.5Qwen Max
LMArena Instruction Following14311262

Long Context Kimi K2.5 leads

Kimi K2.5: 52.1 (#7), Qwen Max: 39.4 (#180)

BenchmarkKimi K2.5Qwen Max
Fiction.LiveBench86.1%66.7%
LMArena Longer Query14451288
CL-bench19.3%—
CL-bench Life13.2%—

Writing & Preference Kimi K2.5 leads

Kimi K2.5: 65.1 (#53), Qwen Max: 47.8 (#205)

BenchmarkKimi K2.5Qwen Max
LMArena Text14451282
LMArena Creative Writing14231248
LMArena Multi-Turn14441277
EQ-Bench Creative Writing1579—

Frequently asked questions

Is Kimi K2.5 better than Qwen Max?

Kimi K2.5 is the stronger model overall, scoring 48.1 to 34.7 on the Noometry Index.

Which is cheaper, Kimi K2.5 or Qwen Max?

Kimi K2.5 is cheaper. It lists at $0.45 per million input tokens and $2.25 per million output tokens; Qwen Max lists at $1.60 and $6.40.

Is Kimi K2.5 or Qwen Max better for coding?

Kimi K2.5 scores higher on coding benchmarks: 48.8 versus 30.7 in the Noometry coding category.

Which has the bigger context window?

Kimi K2.5 does, with 262K tokens against 33K.

How many benchmarks do Kimi K2.5 and Qwen Max share?

21 benchmarks have published results for both models. Kimi K2.5 has 51 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper