Noometry

Model comparison

Gemma 3 1B vs Kimi K2.6

Kimi K2.6 is the stronger model overall, scoring 47.7 to 21.1 on the Noometry Index.

Last verified . 3 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Kimi K2.6 Moonshot AI

47.7

Rank #60 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and Kimi K2.6 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Kimi K2.6 leads 54.0 to 7.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemma 3 1B and 96.1% for Kimi K2.6.

Side by side

Gemma 3 1BKimi K2.6
ProviderGoogleMoonshot AI
Noometry Index21.147.7
Released2025-03-122026-04-20
WeightsOpenOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.95
Output $ / M tokens—$4
Results tracked451

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Kimi K2.6: 50.7 (#43)

BenchmarkGemma 3 1BKimi K2.6
SWE-bench Verified—76.7%
LMArena WebDev—1509
SciCode—53.5%
WeirdML—55.9%
LMArena Coding—1488
ALE-Bench—1,093

Agentic & Tool Use Kimi K2.6 leads

Gemma 3 1B: 13.7 (#152), Kimi K2.6: 21.9 (#137)

BenchmarkGemma 3 1BKimi K2.6
Berkeley Function Calling Leaderboard7.2%—
OSWorld 2.0—4.6%
ExploitBench—18.4%
GBAEval—0.9%
GDP.pdf—12%
Vending-Bench 2—6,205

Reasoning Kimi K2.6 leads

Gemma 3 1B: 19.2 (#264), Kimi K2.6: 40.5 (#55)

BenchmarkGemma 3 1BKimi K2.6
Chess Puzzles0%26%
NYT Connections (extended)—87.2%
CritPt—8%
EBR-Bench—2.4%
LMArena Hard Prompts—1470
Mystery Game Puzzles—18%
DTBench—90.9%
LMCA—37.3%
Epoch Capabilities Index—151.05

Math Kimi K2.6 leads

Gemma 3 1B: 10.2 (#316), Kimi K2.6: 57.0 (#41)

BenchmarkGemma 3 1BKimi K2.6
OTIS Mock AIME 2024-20251.1%96.1%
FrontierMath (Tiers 1-3)—57.2%
FrontierMath Tier 4—25.6%
MathArena Final-Answer Competitions—72.9%
ProofBench—16%
LMArena Math—1475
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%

Knowledge Kimi K2.6 leads

Gemma 3 1B: 7.0 (#314), Kimi K2.6: 54.0 (#54)

BenchmarkGemma 3 1BKimi K2.6
GPQA Diamond19.9%90.8%
SimpleQA Verified—34.9%
Vectara Hallucination Rate—10.8%
LMArena Expert—1491

Multimodal Not comparable

Gemma 3 1B: —, Kimi K2.6: 31.6 (#103)

BenchmarkGemma 3 1BKimi K2.6
LMArena Vision—1283
Blueprint-Bench 2—3.9%
Furniture Assembly—21.7%
LMArena Document—1451

Multilingual Not comparable

Gemma 3 1B: —, Kimi K2.6: 54.9 (#37)

BenchmarkGemma 3 1BKimi K2.6
LMArena Non-English—1446
LMArena Chinese—1521
LMArena French—1471
LMArena German—1450
LMArena Japanese—1443
LMArena Korean—1427
LMArena Russian—1446
LMArena Spanish—1464

Instruction Following Not comparable

Gemma 3 1B: —, Kimi K2.6: 76.3 (#43)

BenchmarkGemma 3 1BKimi K2.6
LMArena Instruction Following—1451

Long Context Not comparable

Gemma 3 1B: —, Kimi K2.6: 44.9 (#52)

BenchmarkGemma 3 1BKimi K2.6
LMArena Longer Query—1468

Writing & Preference Not comparable

Gemma 3 1B: —, Kimi K2.6: 68.5 (#26)

BenchmarkGemma 3 1BKimi K2.6
LMArena Text—1455
LMArena Creative Writing—1434
EQ-Bench Creative Writing—1725
EQ-Bench 4—1202
LMArena Multi-Turn—1453

Frequently asked questions

Is Gemma 3 1B better than Kimi K2.6?

Kimi K2.6 is the stronger model overall, scoring 47.7 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Kimi K2.6 share?

3 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Kimi K2.6 has 51.

Related comparisons

Go deeper