Model comparison
Kimi K2.7 Code vs Llama 3.1 Nemotron 51b Instruct
Kimi K2.7 Code is the stronger model overall, scoring 43.0 to 35.2 on the Noometry Index.
Last verified . 0 shared benchmarks.
NVIDIASummary
- The widest gap is in knowledge, where Kimi K2.7 Code leads 53.6 to 31.3.
Side by side
| Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct | |
|---|---|---|
| Provider | Moonshot AI | NVIDIA |
| Noometry Index | 43.0 | 35.2 |
| Released | 2026-06-12 | — |
| Weights | Open | Open |
| Context window | 262K | — |
| Max output | 262K | — |
| Input $ / M tokens | $0.95 | — |
| Output $ / M tokens | $4 | — |
| Results tracked | 19 | 12 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Kimi K2.7 Code leads
Kimi K2.7 Code: 42.4 (#92), Llama 3.1 Nemotron 51b Instruct: 35.0 (#219)
| Benchmark | Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct |
|---|---|---|
| DeepSWE | 30.5% | — |
| FrontierCode | 30.1% | — |
| LMArena WebDev | 1473 | — |
| SciCode | 47.5% | — |
| WeirdML | 54.1% | — |
| LMArena Coding | — | 1223 |
| ALE-Bench | 886.23 | — |
Agentic & Tool Use Not comparable
Kimi K2.7 Code: 23.9 (#115), Llama 3.1 Nemotron 51b Instruct: —
| Benchmark | Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct |
|---|---|---|
| APEX-Agents | 37.6% | — |
| GBAEval | 0.9% | — |
| Vending-Bench 2 | 5,083 | — |
Reasoning Kimi K2.7 Code leads
Kimi K2.7 Code: 38.2 (#56), Llama 3.1 Nemotron 51b Instruct: 22.5 (#177)
| Benchmark | Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct |
|---|---|---|
| SimpleBench | 57.9% | — |
| CritPt | 10% | — |
| Chess Puzzles | 21% | — |
| LMArena Hard Prompts | — | 1204 |
| Surface Evolver Bench | 48.8% | — |
| Epoch Capabilities Index | 150.01 | — |
Math Kimi K2.7 Code leads
Kimi K2.7 Code: 52.6 (#39), Llama 3.1 Nemotron 51b Instruct: 32.0 (#189)
| Benchmark | Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct |
|---|---|---|
| FrontierMath (Tiers 1-3) | 54% | — |
| FrontierMath Tier 4 | 12.2% | — |
| OTIS Mock AIME 2024-2025 | 95.6% | — |
| LMArena Math | — | 1230 |
Knowledge Kimi K2.7 Code leads
Kimi K2.7 Code: 53.6 (#51), Llama 3.1 Nemotron 51b Instruct: 31.3 (#213)
| Benchmark | Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct |
|---|---|---|
| GPQA Diamond | 87.9% | — |
| SimpleQA Verified | 36.5% | — |
| LMArena Expert | — | 1167 |
Multilingual Not comparable
Kimi K2.7 Code: —, Llama 3.1 Nemotron 51b Instruct: 36.3 (#236)
| Benchmark | Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct |
|---|---|---|
| LMArena Non-English | — | 1181 |
| LMArena Chinese | — | 1179 |
| LMArena Russian | — | 1186 |
Instruction Following Not comparable
Kimi K2.7 Code: —, Llama 3.1 Nemotron 51b Instruct: 63.2 (#228)
| Benchmark | Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct |
|---|---|---|
| LMArena Instruction Following | — | 1201 |
Long Context Not comparable
Kimi K2.7 Code: —, Llama 3.1 Nemotron 51b Instruct: 36.5 (#225)
| Benchmark | Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct |
|---|---|---|
| LMArena Longer Query | — | 1205 |
Writing & Preference Not comparable
Kimi K2.7 Code: —, Llama 3.1 Nemotron 51b Instruct: 43.5 (#224)
| Benchmark | Kimi K2.7 Code | Llama 3.1 Nemotron 51b Instruct |
|---|---|---|
| LMArena Text | — | 1228 |
| LMArena Creative Writing | — | 1213 |
| LMArena Multi-Turn | — | 1227 |
Frequently asked questions
Is Kimi K2.7 Code better than Llama 3.1 Nemotron 51b Instruct?
Kimi K2.7 Code is the stronger model overall, scoring 43.0 to 35.2 on the Noometry Index.
Is Kimi K2.7 Code or Llama 3.1 Nemotron 51b Instruct better for coding?
Kimi K2.7 Code scores higher on coding benchmarks: 42.4 versus 35.0 in the Noometry coding category.
How many benchmarks do Kimi K2.7 Code and Llama 3.1 Nemotron 51b Instruct share?
0 benchmarks have published results for both models. Kimi K2.7 Code has 19 scored results on Noometry and Llama 3.1 Nemotron 51b Instruct has 12.