Noometry

Model comparison

Gemini 1.0 Pro vs Kimi K2.5

Kimi K2.5 is the stronger model overall, scoring 48.1 to 27.3 on the Noometry Index.

Last verified . 19 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Kimi K2.5 Moonshot AI

48.1

Rank #57 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Kimi K2.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K2.5 leads 51.8 to 9.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemini 1.0 Pro and 92.2% for Kimi K2.5.
  • Kimi K2.5 has downloadable open weights; the other is API-only.

Side by side

Gemini 1.0 ProKimi K2.5
ProviderGoogleMoonshot AI
Noometry Index27.348.1
Released2023-12-132026-01-27
WeightsProprietaryOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.45
Output $ / M tokens—$2.25
Results tracked2451

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 leads

Gemini 1.0 Pro: 32.2 (#275), Kimi K2.5: 48.8 (#53)

BenchmarkGemini 1.0 ProKimi K2.5
LMArena Coding11081474
SWE-bench Verified—73.8%
SWE-bench Verified (bash only)—70.8%
LMArena WebDev—1437
SWE-bench Multilingual—67.3%
SciCode—49%
WeirdML—45.6%
ALE-Bench—821.65
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, Kimi K2.5: 34.2 (#48)

BenchmarkGemini 1.0 ProKimi K2.5
Terminal-Bench—43.2%
OSWorld—63.3%
Vending-Bench 2—1,198

Reasoning Kimi K2.5 leads

Gemini 1.0 Pro: 17.1 (#296), Kimi K2.5: 31.2 (#80)

BenchmarkGemini 1.0 ProKimi K2.5
LMArena Hard Prompts11091453
Epoch Capabilities Index117.04148.03
ARC-AGI-2—11.8%
SimpleBench—46.8%
Kagi LLM Benchmark—78.5%
NYT Connections (extended)—69.9%
ARC-AGI-1—65.3%
CritPt—3.1%
Chess Puzzles—12%
EnigmaEval—3.4%
Thematic Generalization—69.4%
DTBench45.9%—

Math Kimi K2.5 leads

Gemini 1.0 Pro: 9.3 (#321), Kimi K2.5: 51.8 (#53)

BenchmarkGemini 1.0 ProKimi K2.5
OTIS Mock AIME 2024-20251.1%92.2%
LMArena Math11321470
MathArena Final-Answer Competitions—62.3%
MATH Level 511.2%—
FrontierMath (Feb 2025 set)—27.9%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Kimi K2.5 leads

Gemini 1.0 Pro: 15.6 (#291), Kimi K2.5: 53.6 (#56)

BenchmarkGemini 1.0 ProKimi K2.5
GPQA Diamond34%87.6%
LMArena Expert10591466
Humanity's Last Exam—24.4%
SimpleQA Verified—34.3%
Vectara Hallucination Rate—14.2%
MMLU70%—

Multimodal Not comparable

Gemini 1.0 Pro: —, Kimi K2.5: 41.1 (#39)

BenchmarkGemini 1.0 ProKimi K2.5
LMArena Vision—1269
LMArena Document—1430

Multilingual Kimi K2.5 leads

Gemini 1.0 Pro: 33.4 (#252), Kimi K2.5: 53.9 (#53)

BenchmarkGemini 1.0 ProKimi K2.5
LMArena Non-English11381433
LMArena Chinese11241495
LMArena French11451454
LMArena German11251441
LMArena Japanese10231421
LMArena Russian11861435
LMArena Spanish11191450
LMArena Korean—1410

Instruction Following Kimi K2.5 leads

Gemini 1.0 Pro: 57.6 (#267), Kimi K2.5: 75.3 (#64)

BenchmarkGemini 1.0 ProKimi K2.5
LMArena Instruction Following11141431

Long Context Kimi K2.5 leads

Gemini 1.0 Pro: 34.3 (#249), Kimi K2.5: 52.1 (#7)

BenchmarkGemini 1.0 ProKimi K2.5
LMArena Longer Query11321445
Fiction.LiveBench—86.1%
CL-bench—19.3%
CL-bench Life—13.2%

Writing & Preference Kimi K2.5 leads

Gemini 1.0 Pro: 36.0 (#264), Kimi K2.5: 65.1 (#53)

BenchmarkGemini 1.0 ProKimi K2.5
LMArena Text11491445
LMArena Creative Writing11311423
LMArena Multi-Turn11391444
EQ-Bench Creative Writing—1579

Frequently asked questions

Is Gemini 1.0 Pro better than Kimi K2.5?

Kimi K2.5 is the stronger model overall, scoring 48.1 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or Kimi K2.5 better for coding?

Kimi K2.5 scores higher on coding benchmarks: 48.8 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Kimi K2.5 share?

19 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Kimi K2.5 has 51.

Related comparisons

Go deeper