Model comparison

Gemini 1.0 Pro vs Kimi K2.5 Instant

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 27.3 on the Noometry Index.

Last verified . 15 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Kimi K2.5 Instant in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K2.5 Instant leads 39.4 to 9.3.
  • Kimi K2.5 Instant has downloadable open weights; the other is API-only.

Side by side

Gemini 1.0 Pro and Kimi K2.5 Instant specifications
Gemini 1.0 ProKimi K2.5 Instant
ProviderGoogleMoonshot AI
Noometry Index27.343.6
Released2023-12-13—
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2418

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Gemini 1.0 Pro: 32.2 (#275), Kimi K2.5 Instant: 42.6 (#97)

Coding benchmarks
BenchmarkGemini 1.0 ProKimi K2.5 Instant
LMArena Coding11081484
LMArena WebDev—1404
HumanEval+55.5%—
MBPP+61.4%—

Reasoning Kimi K2.5 Instant leads

Gemini 1.0 Pro: 17.1 (#296), Kimi K2.5 Instant: 29.7 (#90)

Reasoning benchmarks
BenchmarkGemini 1.0 ProKimi K2.5 Instant
LMArena Hard Prompts11091443
DTBench45.9%—
Epoch Capabilities Index117.04—

Math Kimi K2.5 Instant leads

Gemini 1.0 Pro: 9.3 (#321), Kimi K2.5 Instant: 39.4 (#105)

Math benchmarks
BenchmarkGemini 1.0 ProKimi K2.5 Instant
LMArena Math11321442
OTIS Mock AIME 2024-20251.1%—
MATH Level 511.2%—

Knowledge Kimi K2.5 Instant leads

Gemini 1.0 Pro: 15.6 (#291), Kimi K2.5 Instant: 40.2 (#123)

Knowledge benchmarks
BenchmarkGemini 1.0 ProKimi K2.5 Instant
LMArena Expert10591440
GPQA Diamond34%—
MMLU70%—

Multimodal Not comparable

Gemini 1.0 Pro: —, Kimi K2.5 Instant: 40.2 (#50)

Multimodal benchmarks
BenchmarkGemini 1.0 ProKimi K2.5 Instant
LMArena Vision—1254

Multilingual Kimi K2.5 Instant leads

Gemini 1.0 Pro: 33.4 (#252), Kimi K2.5 Instant: 52.0 (#94)

Multilingual benchmarks
BenchmarkGemini 1.0 ProKimi K2.5 Instant
LMArena Non-English11381406
LMArena Chinese11241449
LMArena French11451403
LMArena German11251413
LMArena Russian11861404
LMArena Spanish11191447
LMArena Japanese1023—
LMArena Korean—1378

Instruction Following Kimi K2.5 Instant leads

Gemini 1.0 Pro: 57.6 (#267), Kimi K2.5 Instant: 75.3 (#65)

Instruction Following benchmarks
BenchmarkGemini 1.0 ProKimi K2.5 Instant
LMArena Instruction Following11141430

Long Context Kimi K2.5 Instant leads

Gemini 1.0 Pro: 34.3 (#249), Kimi K2.5 Instant: 43.9 (#83)

Long Context benchmarks
BenchmarkGemini 1.0 ProKimi K2.5 Instant
LMArena Longer Query11321435

Writing & Preference Kimi K2.5 Instant leads

Gemini 1.0 Pro: 36.0 (#264), Kimi K2.5 Instant: 60.6 (#95)

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProKimi K2.5 Instant
LMArena Text11491420
LMArena Creative Writing11311381
LMArena Multi-Turn11391427

Frequently asked questions

Is Gemini 1.0 Pro better than Kimi K2.5 Instant?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or Kimi K2.5 Instant better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Kimi K2.5 Instant share?

15 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Kimi K2.5 Instant has 18.

Related comparisons

Go deeper