Model comparison

Kimi K2.5 Instant vs Qwen2-72B

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 30.0 on the Noometry Index.

Last verified . 16 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Qwen2-72B Alibaba (Qwen)

30.0

Rank #300 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Kimi K2.5 Instant scores higher in 8 categories and Qwen2-72B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.5 Instant leads 60.6 to 40.8.

Side by side

Kimi K2.5 Instant and Qwen2-72B specifications
Kimi K2.5 InstantQwen2-72B
ProviderMoonshot AIAlibaba (Qwen)
Noometry Index43.630.0
Released—2024-06-07
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1826

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Kimi K2.5 Instant: 42.6 (#97), Qwen2-72B: 29.1 (#310)

Coding benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
LMArena Coding14841196
LMArena WebDev1404—
WeirdML—11.3%
BigCodeBench Instruct—38.5%
BigCodeBench Complete—54%

Agentic & Tool Use Not comparable

Kimi K2.5 Instant: —, Qwen2-72B: 17.0 (#146)

Agentic & Tool Use benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
TheAgentCompany—1.1%
METR Time Horizons—29.9%

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 29.7 (#90), Qwen2-72B: 23.2 (#181)

Reasoning benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
LMArena Hard Prompts14431191
Epoch Capabilities Index—125.28

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.4 (#105), Qwen2-72B: 30.2 (#236)

Math benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
LMArena Math14421235
MATH Level 5—39.1%

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 40.2 (#123), Qwen2-72B: 21.2 (#275)

Knowledge benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
LMArena Expert14401171
GPQA Diamond—40.8%
MMLU—82.4%

Multimodal Not comparable

Kimi K2.5 Instant: 40.2 (#50), Qwen2-72B: —

Multimodal benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
LMArena Vision1254—

Multilingual Kimi K2.5 Instant leads

Kimi K2.5 Instant: 52.0 (#94), Qwen2-72B: 35.9 (#244)

Multilingual benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
LMArena Non-English14061176
LMArena Chinese14491240
LMArena French14031170
LMArena German14131151
LMArena Korean13781083
LMArena Russian14041169
LMArena Spanish14471169
LMArena Japanese—1111

Instruction Following Kimi K2.5 Instant leads

Kimi K2.5 Instant: 75.3 (#65), Qwen2-72B: 61.7 (#241)

Instruction Following benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
LMArena Instruction Following14301181

Long Context Kimi K2.5 Instant leads

Kimi K2.5 Instant: 43.9 (#83), Qwen2-72B: 36.1 (#235)

Long Context benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
LMArena Longer Query14351192

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.6 (#95), Qwen2-72B: 40.8 (#241)

Writing & Preference benchmarks
BenchmarkKimi K2.5 InstantQwen2-72B
LMArena Text14201203
LMArena Creative Writing13811181
LMArena Multi-Turn14271196

Frequently asked questions

Is Kimi K2.5 Instant better than Qwen2-72B?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 30.0 on the Noometry Index.

Is Kimi K2.5 Instant or Qwen2-72B better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 29.1 in the Noometry coding category.

How many benchmarks do Kimi K2.5 Instant and Qwen2-72B share?

16 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Qwen2-72B has 26.

Related comparisons

Go deeper