Model comparison

Falcon-180B vs Kimi K2.6

Kimi K2.6 is the stronger model overall, scoring 47.7 to 32.2 on the Noometry Index.

Last verified . 7 shared benchmarks.

Kimi K2.6 Moonshot AI

47.7

Rank #60 Confirmed

Summary

  • They share 7 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and Kimi K2.6 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.6 leads 68.5 to 29.1.

Side by side

Falcon-180B and Kimi K2.6 specifications
Falcon-180BKimi K2.6
ProviderTechnology Innovation InstituteMoonshot AI
Noometry Index32.247.7
Released2023-09-062026-04-20
WeightsOpenOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.95
Output $ / M tokens—$4
Results tracked1651

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Kimi K2.6: 50.7 (#43)

Coding benchmarks
BenchmarkFalcon-180BKimi K2.6
SWE-bench Verified—76.7%
LMArena WebDev—1509
SciCode—53.5%
WeirdML—55.9%
LMArena Coding—1488
ALE-Bench—1,093

Agentic & Tool Use Not comparable

Falcon-180B: —, Kimi K2.6: 21.9 (#137)

Agentic & Tool Use benchmarks
BenchmarkFalcon-180BKimi K2.6
OSWorld 2.0—4.6%
ExploitBench—18.4%
GBAEval—0.9%
GDP.pdf—12%
Vending-Bench 2—6,205

Reasoning Kimi K2.6 leads

Falcon-180B: 19.1 (#269), Kimi K2.6: 40.5 (#55)

Reasoning benchmarks
BenchmarkFalcon-180BKimi K2.6
LMArena Hard Prompts10071470
Epoch Capabilities Index112.13151.05
NYT Connections (extended)—87.2%
CritPt—8%
Chess Puzzles—26%
EBR-Bench—2.4%
Mystery Game Puzzles—18%
DTBench—90.9%
LMCA—37.3%
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Kimi K2.6: 57.0 (#41)

Knowledge Not comparable

Falcon-180B: —, Kimi K2.6: 54.0 (#54)

Knowledge benchmarks
BenchmarkFalcon-180BKimi K2.6
GPQA Diamond—90.8%
SimpleQA Verified—34.9%
Vectara Hallucination Rate—10.8%
LMArena Expert—1491
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multimodal Not comparable

Falcon-180B: —, Kimi K2.6: 31.6 (#103)

Multimodal benchmarks
BenchmarkFalcon-180BKimi K2.6
LMArena Vision—1283
Blueprint-Bench 2—3.9%
Furniture Assembly—21.7%
LMArena Document—1451

Multilingual Kimi K2.6 leads

Falcon-180B: 25.2 (#286), Kimi K2.6: 54.9 (#37)

Multilingual benchmarks
BenchmarkFalcon-180BKimi K2.6
LMArena Non-English10001446
LMArena Chinese—1521
LMArena French—1471
LMArena German—1450
LMArena Japanese—1443
LMArena Korean—1427
LMArena Russian—1446
LMArena Spanish—1464

Instruction Following Kimi K2.6 leads

Falcon-180B: 53.4 (#286), Kimi K2.6: 76.3 (#43)

Instruction Following benchmarks
BenchmarkFalcon-180BKimi K2.6
LMArena Instruction Following10471451

Long Context Not comparable

Falcon-180B: —, Kimi K2.6: 44.9 (#52)

Long Context benchmarks
BenchmarkFalcon-180BKimi K2.6
LMArena Longer Query—1468

Writing & Preference Kimi K2.6 leads

Falcon-180B: 29.1 (#295), Kimi K2.6: 68.5 (#26)

Writing & Preference benchmarks
BenchmarkFalcon-180BKimi K2.6
LMArena Text10541455
LMArena Creative Writing10891434
LMArena Multi-Turn10131453
EQ-Bench Creative Writing—1725
EQ-Bench 4—1202

Frequently asked questions

Is Falcon-180B better than Kimi K2.6?

Kimi K2.6 is the stronger model overall, scoring 47.7 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and Kimi K2.6 share?

7 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Kimi K2.6 has 51.

Related comparisons

Go deeper