Noometry

Model comparison

Granite 3.0 8b Instruct vs Kimi K2.5

Kimi K2.5 is the stronger model overall, scoring 48.1 to 31.6 on the Noometry Index.

Last verified . 12 shared benchmarks.

Granite 3.0 8b Instruct IBM

31.6

Rank #270 Confirmed

Kimi K2.5 Moonshot AI

48.1

Rank #57 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Granite 3.0 8b Instruct scores higher in 0 categories and Kimi K2.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.5 leads 65.1 to 31.1.

Side by side

Granite 3.0 8b InstructKimi K2.5
ProviderIBMMoonshot AI
Noometry Index31.648.1
Released—2026-01-27
WeightsOpenOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.45
Output $ / M tokens—$2.25
Results tracked1451

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 leads

Granite 3.0 8b Instruct: 29.7 (#301), Kimi K2.5: 48.8 (#53)

BenchmarkGranite 3.0 8b InstructKimi K2.5
LMArena Coding11121474
SWE-bench Verified—73.8%
SWE-bench Verified (bash only)—70.8%
LMArena WebDev—1437
SWE-bench Multilingual—67.3%
SciCode—49%
WeirdML—45.6%
BigCodeBench Instruct29.3%—
BigCodeBench Complete35.4%—
ALE-Bench—821.65

Agentic & Tool Use Not comparable

Granite 3.0 8b Instruct: —, Kimi K2.5: 34.2 (#48)

BenchmarkGranite 3.0 8b InstructKimi K2.5
Terminal-Bench—43.2%
OSWorld—63.3%
Vending-Bench 2—1,198

Reasoning Kimi K2.5 leads

Granite 3.0 8b Instruct: 20.9 (#230), Kimi K2.5: 31.2 (#80)

BenchmarkGranite 3.0 8b InstructKimi K2.5
LMArena Hard Prompts10921453
ARC-AGI-2—11.8%
SimpleBench—46.8%
Kagi LLM Benchmark—78.5%
NYT Connections (extended)—69.9%
ARC-AGI-1—65.3%
CritPt—3.1%
Chess Puzzles—12%
EnigmaEval—3.4%
Thematic Generalization—69.4%
Epoch Capabilities Index—148.03

Math Kimi K2.5 leads

Granite 3.0 8b Instruct: 32.8 (#210), Kimi K2.5: 51.8 (#53)

BenchmarkGranite 3.0 8b InstructKimi K2.5
LMArena Math11431470
MathArena Final-Answer Competitions—62.3%
OTIS Mock AIME 2024-2025—92.2%
FrontierMath (Feb 2025 set)—27.9%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Kimi K2.5 leads

Granite 3.0 8b Instruct: 29.6 (#236), Kimi K2.5: 53.6 (#56)

BenchmarkGranite 3.0 8b InstructKimi K2.5
LMArena Expert10871466
GPQA Diamond—87.6%
Humanity's Last Exam—24.4%
SimpleQA Verified—34.3%
Vectara Hallucination Rate—14.2%

Multimodal Not comparable

Granite 3.0 8b Instruct: —, Kimi K2.5: 41.1 (#39)

BenchmarkGranite 3.0 8b InstructKimi K2.5
LMArena Vision—1269
LMArena Document—1430

Multilingual Kimi K2.5 leads

Granite 3.0 8b Instruct: 27.2 (#276), Kimi K2.5: 53.9 (#53)

BenchmarkGranite 3.0 8b InstructKimi K2.5
LMArena Non-English10371433
LMArena Chinese10631495
LMArena Russian10601435
LMArena French—1454
LMArena German—1441
LMArena Japanese—1421
LMArena Korean—1410
LMArena Spanish—1450

Instruction Following Kimi K2.5 leads

Granite 3.0 8b Instruct: 56.0 (#276), Kimi K2.5: 75.3 (#64)

BenchmarkGranite 3.0 8b InstructKimi K2.5
LMArena Instruction Following10881431

Long Context Kimi K2.5 leads

Granite 3.0 8b Instruct: 34.0 (#252), Kimi K2.5: 52.1 (#7)

BenchmarkGranite 3.0 8b InstructKimi K2.5
LMArena Longer Query11221445
Fiction.LiveBench—86.1%
CL-bench—19.3%
CL-bench Life—13.2%

Writing & Preference Kimi K2.5 leads

Granite 3.0 8b Instruct: 31.1 (#285), Kimi K2.5: 65.1 (#53)

BenchmarkGranite 3.0 8b InstructKimi K2.5
LMArena Text10961445
LMArena Creative Writing10711423
LMArena Multi-Turn10631444
EQ-Bench Creative Writing—1579

Frequently asked questions

Is Granite 3.0 8b Instruct better than Kimi K2.5?

Kimi K2.5 is the stronger model overall, scoring 48.1 to 31.6 on the Noometry Index.

Is Granite 3.0 8b Instruct or Kimi K2.5 better for coding?

Kimi K2.5 scores higher on coding benchmarks: 48.8 versus 29.7 in the Noometry coding category.

How many benchmarks do Granite 3.0 8b Instruct and Kimi K2.5 share?

12 benchmarks have published results for both models. Granite 3.0 8b Instruct has 14 scored results on Noometry and Kimi K2.5 has 51.

Related comparisons

Go deeper