Model comparison

Kimi K2.5 Instant vs Qwen1.5-32B

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 30.5 on the Noometry Index.

Last verified . 16 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Qwen1.5-32B Alibaba (Qwen)

30.5

Rank #293 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Kimi K2.5 Instant scores higher in 8 categories and Qwen1.5-32B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Kimi K2.5 Instant leads 40.2 to 13.5.

Side by side

Kimi K2.5 Instant and Qwen1.5-32B specifications
Kimi K2.5 InstantQwen1.5-32B
ProviderMoonshot AIAlibaba (Qwen)
Noometry Index43.630.5
Released—2024-02-04
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1821

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Kimi K2.5 Instant: 42.6 (#97), Qwen1.5-32B: 31.7 (#282)

Coding benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-32B
LMArena Coding14841155
LMArena WebDev1404—
BigCodeBench Instruct—32.3%
BigCodeBench Complete—42%

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 29.7 (#90), Qwen1.5-32B: 21.8 (#212)

Reasoning benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-32B
LMArena Hard Prompts14431130

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.4 (#105), Qwen1.5-32B: 33.0 (#207)

Math benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-32B
LMArena Math14421155

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 40.2 (#123), Qwen1.5-32B: 13.5 (#296)

Knowledge benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-32B
LMArena Expert14401126
GPQA Diamond—30.7%
MMLU—74.4%

Multimodal Not comparable

Kimi K2.5 Instant: 40.2 (#50), Qwen1.5-32B: —

Multimodal benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-32B
LMArena Vision1254—

Multilingual Kimi K2.5 Instant leads

Kimi K2.5 Instant: 52.0 (#94), Qwen1.5-32B: 31.4 (#259)

Multilingual benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-32B
LMArena Non-English14061106
LMArena Chinese14491177
LMArena French14031101
LMArena German14131058
LMArena Korean13781008
LMArena Russian14041073
LMArena Spanish14471089
LMArena Japanese—1027

Instruction Following Kimi K2.5 Instant leads

Kimi K2.5 Instant: 75.3 (#65), Qwen1.5-32B: 57.7 (#265)

Instruction Following benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-32B
LMArena Instruction Following14301116

Long Context Kimi K2.5 Instant leads

Kimi K2.5 Instant: 43.9 (#83), Qwen1.5-32B: 34.7 (#246)

Long Context benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-32B
LMArena Longer Query14351146

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.6 (#95), Qwen1.5-32B: 34.2 (#271)

Writing & Preference benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-32B
LMArena Text14201137
LMArena Creative Writing13811083
LMArena Multi-Turn14271140

Frequently asked questions

Is Kimi K2.5 Instant better than Qwen1.5-32B?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 30.5 on the Noometry Index.

Is Kimi K2.5 Instant or Qwen1.5-32B better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 31.7 in the Noometry coding category.

How many benchmarks do Kimi K2.5 Instant and Qwen1.5-32B share?

16 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Qwen1.5-32B has 21.

Related comparisons

Go deeper