Model comparison

Grok 4 Fast vs Kimi K2 Thinking Turbo

Kimi K2 Thinking Turbo is the stronger model overall, scoring 45.4 to 39.0 on the Noometry Index.

Last verified . 18 shared benchmarks.

Grok 4 Fast xAI

39.0

Rank #164 Confirmed

Kimi K2 Thinking Turbo Moonshot AI

45.4

Rank #63 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Grok 4 Fast scores higher in 2 categories and Kimi K2 Thinking Turbo in 6 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in long context, where Grok 4 Fast leads 63.2 to 43.2.
  • Kimi K2 Thinking Turbo has downloadable open weights; the other is API-only.

Side by side

Grok 4 Fast and Kimi K2 Thinking Turbo specifications
Grok 4 FastKimi K2 Thinking Turbo
ProviderxAIMoonshot AI
Noometry Index39.045.4
Released2025-09-192025-11-06
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3021

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2 Thinking Turbo leads

Grok 4 Fast: 32.3 (#264), Kimi K2 Thinking Turbo: 38.1 (#166)

Coding benchmarks
BenchmarkGrok 4 FastKimi K2 Thinking Turbo
LMArena WebDev11601322
LMArena Coding14291454
WeirdML42.9%—

Agentic & Tool Use Not comparable

Grok 4 Fast: 29.3 (#80), Kimi K2 Thinking Turbo: —

Agentic & Tool Use benchmarks
BenchmarkGrok 4 FastKimi K2 Thinking Turbo
τ²-bench Banking15.7%—
Cybench30%—
LMArena Search1171—

Reasoning Kimi K2 Thinking Turbo leads

Grok 4 Fast: 22.5 (#179), Kimi K2 Thinking Turbo: 31.4 (#72)

Reasoning benchmarks
BenchmarkGrok 4 FastKimi K2 Thinking Turbo
LMArena Hard Prompts14131428
ARC-AGI-25.3%—
Kagi LLM Benchmark66.1%—
ARC-AGI-148.5%—
Chess Puzzles—20%
DTBench82.7%—
Epoch Capabilities Index144.21—
ForecastBench60.5—

Math Kimi K2 Thinking Turbo leads

Grok 4 Fast: 36.1 (#126), Kimi K2 Thinking Turbo: 45.5 (#62)

Math benchmarks
BenchmarkGrok 4 FastKimi K2 Thinking Turbo
LMArena Math14191429
OTIS Mock AIME 2024-2025—83.1%

Knowledge Kimi K2 Thinking Turbo leads

Grok 4 Fast: 31.5 (#211), Kimi K2 Thinking Turbo: 50.9 (#64)

Knowledge benchmarks
BenchmarkGrok 4 FastKimi K2 Thinking Turbo
LMArena Expert14111439
GPQA Diamond—84.2%
Vectara Hallucination Rate19.7%—

Multilingual Too close to call

Grok 4 Fast: 51.5 (#106), Kimi K2 Thinking Turbo: 51.6 (#104)

Multilingual benchmarks
BenchmarkGrok 4 FastKimi K2 Thinking Turbo
LMArena Non-English13971398
LMArena Chinese14581457
LMArena French14331425
LMArena German13831390
LMArena Japanese13581356
LMArena Korean13591329
LMArena Russian13871390
LMArena Spanish14141407

Instruction Following Too close to call

Grok 4 Fast: 73.4 (#116), Kimi K2 Thinking Turbo: 74.2 (#103)

Instruction Following benchmarks
BenchmarkGrok 4 FastKimi K2 Thinking Turbo
LMArena Instruction Following13881403

Long Context Grok 4 Fast leads

Grok 4 Fast: 63.2 (#3), Kimi K2 Thinking Turbo: 43.2 (#99)

Long Context benchmarks
BenchmarkGrok 4 FastKimi K2 Thinking Turbo
LMArena Longer Query14151415
Fiction.LiveBench94.4%—

Writing & Preference Too close to call

Grok 4 Fast: 60.2 (#96), Kimi K2 Thinking Turbo: 60.2 (#99)

Writing & Preference benchmarks
BenchmarkGrok 4 FastKimi K2 Thinking Turbo
LMArena Text14071415
LMArena Creative Writing13881373
LMArena Multi-Turn14141414

Frequently asked questions

Is Grok 4 Fast better than Kimi K2 Thinking Turbo?

Kimi K2 Thinking Turbo is the stronger model overall, scoring 45.4 to 39.0 on the Noometry Index.

Is Grok 4 Fast or Kimi K2 Thinking Turbo better for coding?

Kimi K2 Thinking Turbo scores higher on coding benchmarks: 38.1 versus 32.3 in the Noometry coding category.

How many benchmarks do Grok 4 Fast and Kimi K2 Thinking Turbo share?

18 benchmarks have published results for both models. Grok 4 Fast has 30 scored results on Noometry and Kimi K2 Thinking Turbo has 21.

Related comparisons

Go deeper