Noometry

Model comparison

Kimi K2.5 Instant vs Llama 4 Scout

Kimi K2.5 Instant is the stronger model overall, scoring 42.9 to 27.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

42.9

Rank #92 Confirmed

Llama 4 Scout Meta

27.4

Rank #323 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Kimi K2.5 Instant scores higher in 9 categories and Llama 4 Scout in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.5 Instant leads 60.8 to 37.1.

Side by side

Kimi K2.5 InstantLlama 4 Scout
ProviderMoonshot AIMeta
Noometry Index42.927.4
Released—2025-04-05
WeightsOpenOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked1843

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Kimi K2.5 Instant: 42.3 (#95), Llama 4 Scout: 19.9 (#334)

BenchmarkKimi K2.5 InstantLlama 4 Scout
LMArena Coding14831286
SWE-bench Verified (bash only)—9.1%
LMArena WebDev1404—
SciCode—17%
BigCodeBench Complete—43.1%

Agentic & Tool Use Not comparable

Kimi K2.5 Instant: —, Llama 4 Scout: 24.4 (#109)

BenchmarkKimi K2.5 InstantLlama 4 Scout
Berkeley Function Calling Leaderboard—28.1%

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 28.5 (#88), Llama 4 Scout: 9.2 (#339)

BenchmarkKimi K2.5 InstantLlama 4 Scout
LMArena Hard Prompts14431266
ARC-AGI-2—0%
Kagi LLM Benchmark—36.9%
ARC-AGI-1—0.5%
CritPt—0%
DTBench—57.9%
LMCA—12%
Epoch Capabilities Index—129.64
ForecastBench—57.5

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 36.6 (#105), Llama 4 Scout: 18.4 (#280)

BenchmarkKimi K2.5 InstantLlama 4 Scout
LMArena Math14431286
OTIS Mock AIME 2024-2025—7.8%
Omni-MATH—37.3%
MATH Level 5—62.3%
FrontierMath (Feb 2025 set)—0%

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.5 (#121), Llama 4 Scout: 31.8 (#208)

BenchmarkKimi K2.5 InstantLlama 4 Scout
LMArena Expert14381236
GPQA Diamond—51.8%
MMLU-Pro—74.2%
Vectara Hallucination Rate—7.7%
GPQA (HELM)—50.7%

Multimodal Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.5 (#47), Llama 4 Scout: 31.6 (#98)

BenchmarkKimi K2.5 InstantLlama 4 Scout
LMArena Vision12541118
SpatialViz-Bench—34.2%

Multilingual Kimi K2.5 Instant leads

Kimi K2.5 Instant: 52.2 (#89), Llama 4 Scout: 41.3 (#207)

BenchmarkKimi K2.5 InstantLlama 4 Scout
LMArena Non-English14061253
LMArena Chinese14501256
LMArena French14031283
LMArena German14131274
LMArena Korean13781207
LMArena Russian14041263
LMArena Spanish14481277
LMArena Japanese—1209

Instruction Following Kimi K2.5 Instant leads

Kimi K2.5 Instant: 75.5 (#61), Llama 4 Scout: 66.0 (#212)

BenchmarkKimi K2.5 InstantLlama 4 Scout
LMArena Instruction Following14301248
IFEval—81.8%

Long Context Kimi K2.5 Instant leads

Kimi K2.5 Instant: 43.8 (#82), Llama 4 Scout: 27.5 (#289)

BenchmarkKimi K2.5 InstantLlama 4 Scout
LMArena Longer Query14351265
Fiction.LiveBench—36%

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.8 (#91), Llama 4 Scout: 37.1 (#256)

BenchmarkKimi K2.5 InstantLlama 4 Scout
LMArena Text14201279
LMArena Creative Writing13791249
LMArena Multi-Turn14271281
EQ-Bench Creative Writing—783
WildBench—78%

Frequently asked questions

Is Kimi K2.5 Instant better than Llama 4 Scout?

Kimi K2.5 Instant is the stronger model overall, scoring 42.9 to 27.4 on the Noometry Index.

Is Kimi K2.5 Instant or Llama 4 Scout better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.3 versus 19.9 in the Noometry coding category.

How many benchmarks do Kimi K2.5 Instant and Llama 4 Scout share?

17 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Llama 4 Scout has 43.

Related comparisons

Go deeper