Model comparison

Kimi K3 vs Olmo 3.1 32b Think

Kimi K3 is the stronger model overall, scoring 59.5 to 37.9 on the Noometry Index.

Last verified . 15 shared benchmarks.

Kimi K3 Moonshot AI

59.5

Rank #15 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Kimi K3 scores higher in 8 categories and Olmo 3.1 32b Think in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K3 leads 74.2 to 36.3.

Side by side

Kimi K3 and Olmo 3.1 32b Think specifications
Kimi K3Olmo 3.1 32b Think
ProviderMoonshot AIAllen Institute for AI (Ai2)
Noometry Index59.537.9
Released2026-07-16—
WeightsOpenOpen
Context window1.05M—
Max output1.05M—
Input $ / M tokens$3—
Output $ / M tokens$15—
Results tracked5315

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K3 leads

Kimi K3: 61.0 (#10), Olmo 3.1 32b Think: 37.7 (#189)

Coding benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
LMArena Coding15081291
DeepSWE68.5%—
FrontierCode44.2%—
LMArena WebDev1654—
FrontierSWE25.9%—
SciCode59.5%—
WeirdML82.6%—
ALE-Bench1,524—

Agentic & Tool Use Not comparable

Kimi K3: 41.8 (#20), Olmo 3.1 32b Think: —

Agentic & Tool Use benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
APEX-Agents50.6%—
τ²-bench Banking37.1%—
PostTrainBench32%—
GBAEval48.3%—
GDP.pdf19%—
Vending-Bench 25,165—

Reasoning Kimi K3 leads

Kimi K3: 63.0 (#17), Olmo 3.1 32b Think: 25.2 (#150)

Reasoning benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
LMArena Hard Prompts14961272
ARC-AGI-260.4%—
SimpleBench60.7%—
NYT Connections (extended)93.6%—
ARC-AGI-194.5%—
CritPt23.4%—
Chess Puzzles39%—
Mystery Game Puzzles26%—
DTBench91.2%—
LMCA52.7%—
Surface Evolver Bench95%—
Epoch Capabilities Index157.45—
ForecastBench61.1—

Math Kimi K3 leads

Kimi K3: 74.2 (#16), Olmo 3.1 32b Think: 36.3 (#168)

Math benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
LMArena Math14911305
FrontierMath (Tiers 1-3)72.2%—
FrontierMath Tier 439%—
MathArena Final-Answer Competitions87.8%—
OTIS Mock AIME 2024-202597.2%—
ProofBench87%—

Knowledge Kimi K3 leads

Kimi K3: 63.2 (#21), Olmo 3.1 32b Think: 35.7 (#181)

Knowledge benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
LMArena Expert15211295
GPQA Diamond93.1%—
SimpleQA Verified50.6%—

Multimodal Not comparable

Kimi K3: 37.8 (#70), Olmo 3.1 32b Think: —

Multimodal benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
Blueprint-Bench 229.5%—
Furniture Assembly34.2%—

Multilingual Kimi K3 leads

Kimi K3: 56.3 (#21), Olmo 3.1 32b Think: 38.1 (#231)

Multilingual benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
LMArena Non-English14661209
LMArena Chinese15291242
LMArena French14911260
LMArena German14881262
LMArena Russian14821193
LMArena Spanish14721289
LMArena Japanese1487—
LMArena Korean1458—

Instruction Following Kimi K3 leads

Kimi K3: 77.7 (#14), Olmo 3.1 32b Think: 65.6 (#218)

Instruction Following benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
LMArena Instruction Following14831247

Long Context Kimi K3 leads

Kimi K3: 45.8 (#29), Olmo 3.1 32b Think: 38.6 (#195)

Long Context benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
LMArena Longer Query14941272

Writing & Preference Kimi K3 leads

Kimi K3: 76.6 (#4), Olmo 3.1 32b Think: 46.2 (#220)

Writing & Preference benchmarks
BenchmarkKimi K3Olmo 3.1 32b Think
LMArena Text14761272
LMArena Creative Writing14541226
LMArena Multi-Turn14881252
EQ-Bench Creative Writing2082—
EQ-Bench 41339—

Frequently asked questions

Is Kimi K3 better than Olmo 3.1 32b Think?

Kimi K3 is the stronger model overall, scoring 59.5 to 37.9 on the Noometry Index.

Is Kimi K3 or Olmo 3.1 32b Think better for coding?

Kimi K3 scores higher on coding benchmarks: 61.0 versus 37.7 in the Noometry coding category.

How many benchmarks do Kimi K3 and Olmo 3.1 32b Think share?

15 benchmarks have published results for both models. Kimi K3 has 53 scored results on Noometry and Olmo 3.1 32b Think has 15.

Related comparisons

Go deeper