Noometry

Model comparison

Gemma 7B vs Kimi K2.6

Kimi K2.6 is the stronger model overall, scoring 47.7 to 30.0 on the Noometry Index.

Last verified . 14 shared benchmarks.

Gemma 7B Google

30.0

Rank #299 Confirmed

Kimi K2.6 Moonshot AI

47.7

Rank #60 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Gemma 7B scores higher in 0 categories and Kimi K2.6 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.6 leads 68.5 to 27.1.

Side by side

Gemma 7BKimi K2.6
ProviderGoogleMoonshot AI
Noometry Index30.047.7
Released2024-02-212026-04-20
WeightsOpenOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.95
Output $ / M tokens—$4
Results tracked2751

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.6 leads

Gemma 7B: 30.5 (#294), Kimi K2.6: 50.7 (#43)

BenchmarkGemma 7BKimi K2.6
LMArena Coding10481488
SWE-bench Verified—76.7%
LMArena WebDev—1509
SciCode—53.5%
WeirdML—55.9%
ALE-Bench—1,093
HumanEval+28.7%—
MBPP+43.4%—

Agentic & Tool Use Not comparable

Gemma 7B: —, Kimi K2.6: 21.9 (#137)

BenchmarkGemma 7BKimi K2.6
OSWorld 2.0—4.6%
ExploitBench—18.4%
GBAEval—0.9%
GDP.pdf—12%
Vending-Bench 2—6,205

Reasoning Kimi K2.6 leads

Gemma 7B: 19.9 (#249), Kimi K2.6: 40.5 (#55)

BenchmarkGemma 7BKimi K2.6
LMArena Hard Prompts10421470
Epoch Capabilities Index111.99151.05
NYT Connections (extended)—87.2%
CritPt—8%
Chess Puzzles—26%
EBR-Bench—2.4%
Mystery Game Puzzles—18%
DTBench—90.9%
LMCA—37.3%
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Kimi K2.6 leads

Gemma 7B: 31.2 (#228), Kimi K2.6: 57.0 (#41)

BenchmarkGemma 7BKimi K2.6
LMArena Math10661475
FrontierMath (Tiers 1-3)—57.2%
FrontierMath Tier 4—25.6%
MathArena Final-Answer Competitions—72.9%
OTIS Mock AIME 2024-2025—96.1%
ProofBench—16%
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%
GSM8K46.4%—

Knowledge Kimi K2.6 leads

Gemma 7B: 27.3 (#252), Kimi K2.6: 54.0 (#54)

BenchmarkGemma 7BKimi K2.6
LMArena Expert10011491
GPQA Diamond—90.8%
SimpleQA Verified—34.9%
Vectara Hallucination Rate—10.8%
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multimodal Not comparable

Gemma 7B: —, Kimi K2.6: 31.6 (#103)

BenchmarkGemma 7BKimi K2.6
LMArena Vision—1283
Blueprint-Bench 2—3.9%
Furniture Assembly—21.7%
LMArena Document—1451

Multilingual Kimi K2.6 leads

Gemma 7B: 25.1 (#287), Kimi K2.6: 54.9 (#37)

BenchmarkGemma 7BKimi K2.6
LMArena Non-English9991446
LMArena Chinese10351521
LMArena French10251471
LMArena Russian9931446
LMArena German—1450
LMArena Japanese—1443
LMArena Korean—1427
LMArena Spanish—1464

Instruction Following Kimi K2.6 leads

Gemma 7B: 51.5 (#295), Kimi K2.6: 76.3 (#43)

BenchmarkGemma 7BKimi K2.6
LMArena Instruction Following10171451

Long Context Kimi K2.6 leads

Gemma 7B: 31.1 (#282), Kimi K2.6: 44.9 (#52)

BenchmarkGemma 7BKimi K2.6
LMArena Longer Query10221468

Writing & Preference Kimi K2.6 leads

Gemma 7B: 27.1 (#302), Kimi K2.6: 68.5 (#26)

BenchmarkGemma 7BKimi K2.6
LMArena Text10561455
LMArena Creative Writing10241434
LMArena Multi-Turn9631453
EQ-Bench Creative Writing—1725
EQ-Bench 4—1202

Frequently asked questions

Is Gemma 7B better than Kimi K2.6?

Kimi K2.6 is the stronger model overall, scoring 47.7 to 30.0 on the Noometry Index.

Is Gemma 7B or Kimi K2.6 better for coding?

Kimi K2.6 scores higher on coding benchmarks: 50.7 versus 30.5 in the Noometry coding category.

How many benchmarks do Gemma 7B and Kimi K2.6 share?

14 benchmarks have published results for both models. Gemma 7B has 27 scored results on Noometry and Kimi K2.6 has 51.

Related comparisons

Go deeper