Model comparison

Kimi K2.7 Code vs Llama 2-13B

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 29.6 on the Noometry Index.

Last verified . 2 shared benchmarks.

Kimi K2.7 Code Moonshot AI

43.3

Rank #94 Confirmed

Llama 2-13B Meta

29.6

Rank #309 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Kimi K2.7 Code scores higher in 4 categories and Llama 2-13B in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Kimi K2.7 Code leads 39.0 to 12.8.
  • The biggest single-benchmark swing is Chess Puzzles: 21% for Kimi K2.7 Code and 0% for Llama 2-13B.

Side by side

Kimi K2.7 Code and Llama 2-13B specifications
Kimi K2.7 CodeLlama 2-13B
ProviderMoonshot AIMeta
Noometry Index43.329.6
Released2026-06-122023-07-18
WeightsOpenOpen
Context window262K—
Max output262K—
Input $ / M tokens$0.95—
Output $ / M tokens$4—
Results tracked1932

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.7 Code leads

Kimi K2.7 Code: 42.9 (#95), Llama 2-13B: 30.9 (#291)

Coding benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
DeepSWE30.5%—
FrontierCode30.1%—
LMArena WebDev1473—
SciCode47.5%—
WeirdML54.1%—
LMArena Coding—1062
ALE-Bench886.23—

Agentic & Tool Use Not comparable

Kimi K2.7 Code: 24.0 (#122), Llama 2-13B: —

Agentic & Tool Use benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
APEX-Agents37.6%—
GBAEval0.9%—
Vending-Bench 25,083—

Reasoning Kimi K2.7 Code leads

Kimi K2.7 Code: 39.0 (#61), Llama 2-13B: 12.8 (#337)

Reasoning benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
Chess Puzzles21%0%
Epoch Capabilities Index149.97106.17
SimpleBench57.9%—
CritPt10%—
LMArena Hard Prompts—1051
DTBench—42.2%
Surface Evolver Bench48.8%—
BIG-Bench Hard—58.2%
HellaSwag—80.7%
LAMBADA—76.5%
PIQA—80.8%
WinoGrande—72.8%

Math Kimi K2.7 Code leads

Kimi K2.7 Code: 52.9 (#48), Llama 2-13B: 31.1 (#229)

Math benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
FrontierMath (Tiers 1-3)54%—
FrontierMath Tier 412.2%—
OTIS Mock AIME 2024-202595.6%—
LMArena Math—1065
GSM8K—36.9%

Knowledge Kimi K2.7 Code leads

Kimi K2.7 Code: 53.5 (#57), Llama 2-13B: 28.1 (#249)

Knowledge benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
GPQA Diamond87.9%—
SimpleQA Verified36.5%—
LMArena Expert—1030
ARC (AI2) Challenge—60.3%
BoolQ—82.4%
MMLU—55.6%
OpenBookQA—57%
TriviaQA—79.6%

Multimodal Not comparable

Kimi K2.7 Code: —, Llama 2-13B: —

Multimodal benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
ScienceQA—55.8%

Multilingual Not comparable

Kimi K2.7 Code: —, Llama 2-13B: 26.5 (#279)

Multilingual benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
LMArena Non-English—1024
LMArena Chinese—1001
LMArena French—1044
LMArena German—1009
LMArena Japanese—894
LMArena Korean—953
LMArena Russian—1055
LMArena Spanish—1087

Instruction Following Not comparable

Kimi K2.7 Code: —, Llama 2-13B: 53.3 (#287)

Instruction Following benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
LMArena Instruction Following—1045

Long Context Not comparable

Kimi K2.7 Code: —, Llama 2-13B: 32.3 (#269)

Long Context benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
LMArena Longer Query—1064

Writing & Preference Not comparable

Kimi K2.7 Code: —, Llama 2-13B: 29.8 (#289)

Writing & Preference benchmarks
BenchmarkKimi K2.7 CodeLlama 2-13B
LMArena Text—1084
LMArena Creative Writing—1047
LMArena Multi-Turn—1050

Frequently asked questions

Is Kimi K2.7 Code better than Llama 2-13B?

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 29.6 on the Noometry Index.

Is Kimi K2.7 Code or Llama 2-13B better for coding?

Kimi K2.7 Code scores higher on coding benchmarks: 42.9 versus 30.9 in the Noometry coding category.

How many benchmarks do Kimi K2.7 Code and Llama 2-13B share?

2 benchmarks have published results for both models. Kimi K2.7 Code has 19 scored results on Noometry and Llama 2-13B has 32.

Related comparisons

Go deeper