Model comparison

Kimi K2.5 Instant vs Qwen1.5-7B

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 31.4 on the Noometry Index.

Last verified . 12 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Qwen1.5-7B Alibaba (Qwen)

31.4

Rank #273 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Kimi K2.5 Instant scores higher in 8 categories and Qwen1.5-7B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.5 Instant leads 60.6 to 29.6.

Side by side

Kimi K2.5 Instant and Qwen1.5-7B specifications
Kimi K2.5 InstantQwen1.5-7B
ProviderMoonshot AIAlibaba (Qwen)
Noometry Index43.631.4
Released—2024-02-04
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1813

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Kimi K2.5 Instant: 42.6 (#97), Qwen1.5-7B: 32.2 (#276)

Coding benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-7B
LMArena Coding14841107
LMArena WebDev1404—

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 29.7 (#90), Qwen1.5-7B: 20.4 (#240)

Reasoning benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-7B
LMArena Hard Prompts14431065

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.4 (#105), Qwen1.5-7B: 31.4 (#224)

Math benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-7B
LMArena Math14421080

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 40.2 (#123), Qwen1.5-7B: 28.7 (#243)

Knowledge benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-7B
LMArena Expert14401055
MMLU—62.6%

Multimodal Not comparable

Kimi K2.5 Instant: 40.2 (#50), Qwen1.5-7B: —

Multimodal benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-7B
LMArena Vision1254—

Multilingual Kimi K2.5 Instant leads

Kimi K2.5 Instant: 52.0 (#94), Qwen1.5-7B: 28.5 (#271)

Multilingual benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-7B
LMArena Non-English14061058
LMArena Chinese14491141
LMArena Russian14041006
LMArena French1403—
LMArena German1413—
LMArena Korean1378—
LMArena Spanish1447—

Instruction Following Kimi K2.5 Instant leads

Kimi K2.5 Instant: 75.3 (#65), Qwen1.5-7B: 54.1 (#281)

Instruction Following benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-7B
LMArena Instruction Following14301058

Long Context Kimi K2.5 Instant leads

Kimi K2.5 Instant: 43.9 (#83), Qwen1.5-7B: 33.1 (#266)

Long Context benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-7B
LMArena Longer Query14351090

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.6 (#95), Qwen1.5-7B: 29.6 (#293)

Writing & Preference benchmarks
BenchmarkKimi K2.5 InstantQwen1.5-7B
LMArena Text14201083
LMArena Creative Writing13811035
LMArena Multi-Turn14271062

Frequently asked questions

Is Kimi K2.5 Instant better than Qwen1.5-7B?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 31.4 on the Noometry Index.

Is Kimi K2.5 Instant or Qwen1.5-7B better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 32.2 in the Noometry coding category.

How many benchmarks do Kimi K2.5 Instant and Qwen1.5-7B share?

12 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Qwen1.5-7B has 13.

Related comparisons

Go deeper