Model comparison

Gemini 1.5 Flash 8B vs Kimi K2.7 Code

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 29.9 on the Noometry Index.

Last verified . 2 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Kimi K2.7 Code Moonshot AI

43.3

Rank #94 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Kimi K2.7 Code in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K2.7 Code leads 52.9 to 14.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 95.6% for Kimi K2.7 Code.
  • Kimi K2.7 Code has downloadable open weights; the other is API-only.

Side by side

Gemini 1.5 Flash 8B and Kimi K2.7 Code specifications
Gemini 1.5 Flash 8BKimi K2.7 Code
ProviderGoogleMoonshot AI
Noometry Index29.943.3
Released2024-10-032026-06-12
WeightsProprietaryOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.95
Output $ / M tokens—$4
Results tracked2119

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.7 Code leads

Gemini 1.5 Flash 8B: 35.5 (#225), Kimi K2.7 Code: 42.9 (#95)

Coding benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
DeepSWE—30.5%
FrontierCode—30.1%
LMArena WebDev—1473
SciCode—47.5%
WeirdML—54.1%
LMArena Coding1218—
ALE-Bench—886.23

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Kimi K2.7 Code: 24.0 (#122)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
APEX-Agents—37.6%
GBAEval—0.9%
Vending-Bench 2—5,083

Reasoning Kimi K2.7 Code leads

Gemini 1.5 Flash 8B: 20.0 (#244), Kimi K2.7 Code: 39.0 (#61)

Reasoning benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
SimpleBench—57.9%
CritPt—10%
Chess Puzzles—21%
LMArena Hard Prompts1209—
DTBench50%—
Surface Evolver Bench—48.8%
Epoch Capabilities Index—149.97

Math Kimi K2.7 Code leads

Gemini 1.5 Flash 8B: 14.2 (#302), Kimi K2.7 Code: 52.9 (#48)

Math benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
OTIS Mock AIME 2024-20254.6%95.6%
FrontierMath (Tiers 1-3)—54%
FrontierMath Tier 4—12.2%
LMArena Math1207—

Knowledge Kimi K2.7 Code leads

Gemini 1.5 Flash 8B: 16.0 (#289), Kimi K2.7 Code: 53.5 (#57)

Knowledge benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
GPQA Diamond33%87.9%
SimpleQA Verified—36.5%
LMArena Expert1185—

Multimodal Not comparable

Gemini 1.5 Flash 8B: 28.2 (#115), Kimi K2.7 Code: —

Multimodal benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
LMArena Vision1044—

Multilingual Not comparable

Gemini 1.5 Flash 8B: 38.5 (#229), Kimi K2.7 Code: —

Multilingual benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
LMArena Non-English1215—
LMArena Chinese1231—
LMArena French1234—
LMArena German1206—
LMArena Japanese1150—
LMArena Korean1140—
LMArena Russian1236—
LMArena Spanish1212—

Instruction Following Not comparable

Gemini 1.5 Flash 8B: 62.8 (#236), Kimi K2.7 Code: —

Instruction Following benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
LMArena Instruction Following1199—

Long Context Not comparable

Gemini 1.5 Flash 8B: 37.0 (#225), Kimi K2.7 Code: —

Long Context benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
LMArena Longer Query1219—

Writing & Preference Not comparable

Gemini 1.5 Flash 8B: 42.8 (#232), Kimi K2.7 Code: —

Writing & Preference benchmarks
BenchmarkGemini 1.5 Flash 8BKimi K2.7 Code
LMArena Text1226—
LMArena Creative Writing1218—
LMArena Multi-Turn1185—

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Kimi K2.7 Code?

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Kimi K2.7 Code better for coding?

Kimi K2.7 Code scores higher on coding benchmarks: 42.9 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Kimi K2.7 Code share?

2 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Kimi K2.7 Code has 19.

Related comparisons

Go deeper