Model comparison

Kimi K2.5 Instant vs Yi-1.5-34B

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 30.6 on the Noometry Index.

Last verified . 16 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Kimi K2.5 Instant scores higher in 8 categories and Yi-1.5-34B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Kimi K2.5 Instant leads 40.2 to 14.8.

Side by side

Kimi K2.5 Instant and Yi-1.5-34B specifications
Kimi K2.5 InstantYi-1.5-34B
ProviderMoonshot AI01.AI
Noometry Index43.630.6
Released—2024-05-13
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1821

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Kimi K2.5 Instant: 42.6 (#97), Yi-1.5-34B: 32.4 (#272)

Coding benchmarks
BenchmarkKimi K2.5 InstantYi-1.5-34B
LMArena Coding14841169
LMArena WebDev1404—
BigCodeBench Instruct—33.9%
BigCodeBench Complete—43.8%

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 29.7 (#90), Yi-1.5-34B: 22.5 (#191)

Reasoning benchmarks
BenchmarkKimi K2.5 InstantYi-1.5-34B
LMArena Hard Prompts14431160

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.4 (#105), Yi-1.5-34B: 27.5 (#249)

Math benchmarks
BenchmarkKimi K2.5 InstantYi-1.5-34B
LMArena Math14421182
MATH Level 5—25.5%

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 40.2 (#123), Yi-1.5-34B: 14.8 (#295)

Knowledge benchmarks
BenchmarkKimi K2.5 InstantYi-1.5-34B
LMArena Expert14401144
GPQA Diamond—32%

Multimodal Not comparable

Kimi K2.5 Instant: 40.2 (#50), Yi-1.5-34B: —

Multimodal benchmarks
BenchmarkKimi K2.5 InstantYi-1.5-34B
LMArena Vision1254—

Multilingual Kimi K2.5 Instant leads

Kimi K2.5 Instant: 52.0 (#94), Yi-1.5-34B: 32.3 (#256)

Multilingual benchmarks
BenchmarkKimi K2.5 InstantYi-1.5-34B
LMArena Non-English14061121
LMArena Chinese14491213
LMArena French14031156
LMArena German14131111
LMArena Korean13781005
LMArena Russian14041091
LMArena Spanish14471121
LMArena Japanese—1021

Instruction Following Kimi K2.5 Instant leads

Kimi K2.5 Instant: 75.3 (#65), Yi-1.5-34B: 59.2 (#257)

Instruction Following benchmarks
BenchmarkKimi K2.5 InstantYi-1.5-34B
LMArena Instruction Following14301139

Long Context Kimi K2.5 Instant leads

Kimi K2.5 Instant: 43.9 (#83), Yi-1.5-34B: 34.6 (#248)

Long Context benchmarks
BenchmarkKimi K2.5 InstantYi-1.5-34B
LMArena Longer Query14351143

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.6 (#95), Yi-1.5-34B: 37.4 (#257)

Writing & Preference benchmarks
BenchmarkKimi K2.5 InstantYi-1.5-34B
LMArena Text14201173
LMArena Creative Writing13811135
LMArena Multi-Turn14271153

Frequently asked questions

Is Kimi K2.5 Instant better than Yi-1.5-34B?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 30.6 on the Noometry Index.

Is Kimi K2.5 Instant or Yi-1.5-34B better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 32.4 in the Noometry coding category.

How many benchmarks do Kimi K2.5 Instant and Yi-1.5-34B share?

16 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper