Model comparison

Gemma 7B vs Kimi K2.7 Code

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 30.0 on the Noometry Index.

Last verified . 1 shared benchmarks.

Gemma 7B Google

30.0

Rank #299 Confirmed

Kimi K2.7 Code Moonshot AI

43.3

Rank #94 Confirmed

Summary

  • They share 1 benchmark with published results for both. Gemma 7B scores higher in 0 categories and Kimi K2.7 Code in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Kimi K2.7 Code leads 53.5 to 27.3.

Side by side

Gemma 7B and Kimi K2.7 Code specifications
Gemma 7BKimi K2.7 Code
ProviderGoogleMoonshot AI
Noometry Index30.043.3
Released2024-02-212026-06-12
WeightsOpenOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.95
Output $ / M tokens—$4
Results tracked2719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.7 Code leads

Gemma 7B: 30.5 (#294), Kimi K2.7 Code: 42.9 (#95)

Coding benchmarks
BenchmarkGemma 7BKimi K2.7 Code
DeepSWE—30.5%
FrontierCode—30.1%
LMArena WebDev—1473
SciCode—47.5%
WeirdML—54.1%
LMArena Coding1048—
ALE-Bench—886.23
HumanEval+28.7%—
MBPP+43.4%—

Agentic & Tool Use Not comparable

Gemma 7B: —, Kimi K2.7 Code: 24.0 (#122)

Agentic & Tool Use benchmarks
BenchmarkGemma 7BKimi K2.7 Code
APEX-Agents—37.6%
GBAEval—0.9%
Vending-Bench 2—5,083

Reasoning Kimi K2.7 Code leads

Gemma 7B: 19.9 (#249), Kimi K2.7 Code: 39.0 (#61)

Reasoning benchmarks
BenchmarkGemma 7BKimi K2.7 Code
Epoch Capabilities Index111.99149.97
SimpleBench—57.9%
CritPt—10%
Chess Puzzles—21%
LMArena Hard Prompts1042—
Surface Evolver Bench—48.8%
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Kimi K2.7 Code leads

Gemma 7B: 31.2 (#228), Kimi K2.7 Code: 52.9 (#48)

Math benchmarks
BenchmarkGemma 7BKimi K2.7 Code
FrontierMath (Tiers 1-3)—54%
FrontierMath Tier 4—12.2%
OTIS Mock AIME 2024-2025—95.6%
LMArena Math1066—
GSM8K46.4%—

Knowledge Kimi K2.7 Code leads

Gemma 7B: 27.3 (#252), Kimi K2.7 Code: 53.5 (#57)

Knowledge benchmarks
BenchmarkGemma 7BKimi K2.7 Code
GPQA Diamond—87.9%
SimpleQA Verified—36.5%
LMArena Expert1001—
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multilingual Not comparable

Gemma 7B: 25.1 (#287), Kimi K2.7 Code: —

Multilingual benchmarks
BenchmarkGemma 7BKimi K2.7 Code
LMArena Non-English999—
LMArena Chinese1035—
LMArena French1025—
LMArena Russian993—

Instruction Following Not comparable

Gemma 7B: 51.5 (#295), Kimi K2.7 Code: —

Instruction Following benchmarks
BenchmarkGemma 7BKimi K2.7 Code
LMArena Instruction Following1017—

Long Context Not comparable

Gemma 7B: 31.1 (#282), Kimi K2.7 Code: —

Long Context benchmarks
BenchmarkGemma 7BKimi K2.7 Code
LMArena Longer Query1022—

Writing & Preference Not comparable

Gemma 7B: 27.1 (#302), Kimi K2.7 Code: —

Writing & Preference benchmarks
BenchmarkGemma 7BKimi K2.7 Code
LMArena Text1056—
LMArena Creative Writing1024—
LMArena Multi-Turn963—

Frequently asked questions

Is Gemma 7B better than Kimi K2.7 Code?

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 30.0 on the Noometry Index.

Is Gemma 7B or Kimi K2.7 Code better for coding?

Kimi K2.7 Code scores higher on coding benchmarks: 42.9 versus 30.5 in the Noometry coding category.

How many benchmarks do Gemma 7B and Kimi K2.7 Code share?

1 benchmark has published results for both models. Gemma 7B has 27 scored results on Noometry and Kimi K2.7 Code has 19.

Related comparisons

Go deeper