Model comparison

Granite 3.1 8b Instruct vs Kimi K2.5 Instant

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 32.4 on the Noometry Index.

Last verified . 12 shared benchmarks.

Granite 3.1 8b Instruct IBM

32.4

Rank #258 Confirmed

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Granite 3.1 8b Instruct scores higher in 0 categories and Kimi K2.5 Instant in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.5 Instant leads 60.6 to 35.5.

Side by side

Granite 3.1 8b Instruct and Kimi K2.5 Instant specifications
Granite 3.1 8b InstructKimi K2.5 Instant
ProviderIBMMoonshot AI
Noometry Index32.443.6
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Granite 3.1 8b Instruct: 34.5 (#233), Kimi K2.5 Instant: 42.6 (#97)

Coding benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
LMArena Coding11861484
LMArena WebDev—1404

Agentic & Tool Use Not comparable

Granite 3.1 8b Instruct: 24.1 (#120), Kimi K2.5 Instant: —

Agentic & Tool Use benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
Berkeley Function Calling Leaderboard27.1%—

Reasoning Kimi K2.5 Instant leads

Granite 3.1 8b Instruct: 22.1 (#207), Kimi K2.5 Instant: 29.7 (#90)

Reasoning benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
LMArena Hard Prompts11451443

Math Kimi K2.5 Instant leads

Granite 3.1 8b Instruct: 33.0 (#209), Kimi K2.5 Instant: 39.4 (#105)

Math benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
LMArena Math11521442

Knowledge Kimi K2.5 Instant leads

Granite 3.1 8b Instruct: 31.1 (#220), Kimi K2.5 Instant: 40.2 (#123)

Knowledge benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
LMArena Expert11421440

Multimodal Not comparable

Granite 3.1 8b Instruct: —, Kimi K2.5 Instant: 40.2 (#50)

Multimodal benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
LMArena Vision—1254

Multilingual Kimi K2.5 Instant leads

Granite 3.1 8b Instruct: 30.9 (#260), Kimi K2.5 Instant: 52.0 (#94)

Multilingual benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
LMArena Non-English10991406
LMArena Chinese11451449
LMArena Russian10921404
LMArena French—1403
LMArena German—1413
LMArena Korean—1378
LMArena Spanish—1447

Instruction Following Kimi K2.5 Instant leads

Granite 3.1 8b Instruct: 58.6 (#259), Kimi K2.5 Instant: 75.3 (#65)

Instruction Following benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
LMArena Instruction Following11311430

Long Context Kimi K2.5 Instant leads

Granite 3.1 8b Instruct: 35.2 (#241), Kimi K2.5 Instant: 43.9 (#83)

Long Context benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
LMArena Longer Query11621435

Writing & Preference Kimi K2.5 Instant leads

Granite 3.1 8b Instruct: 35.5 (#266), Kimi K2.5 Instant: 60.6 (#95)

Writing & Preference benchmarks
BenchmarkGranite 3.1 8b InstructKimi K2.5 Instant
LMArena Text11501420
LMArena Creative Writing11291381
LMArena Multi-Turn11081427

Frequently asked questions

Is Granite 3.1 8b Instruct better than Kimi K2.5 Instant?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 32.4 on the Noometry Index.

Is Granite 3.1 8b Instruct or Kimi K2.5 Instant better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 34.5 in the Noometry coding category.

How many benchmarks do Granite 3.1 8b Instruct and Kimi K2.5 Instant share?

12 benchmarks have published results for both models. Granite 3.1 8b Instruct has 13 scored results on Noometry and Kimi K2.5 Instant has 18.

Related comparisons

Go deeper