Model comparison

DeepSeek Coder 6.7B vs Grok 4.1

Grok 4.1 has enough public results to be ranked (#135); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

DeepSeek Coder 6.7B DeepSeek

37.1

Unranked Sparse

Grok 4.1 xAI

40.8

Rank #135 Confirmed

Summary

  • DeepSeek Coder 6.7B has downloadable open weights; the other is API-only.

Side by side

DeepSeek Coder 6.7B and Grok 4.1 specifications
DeepSeek Coder 6.7BGrok 4.1
ProviderDeepSeekxAI
Noometry Index37.140.8
Released2023-11-022025-11-17
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked919

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek Coder 6.7B leads

DeepSeek Coder 6.7B: 35.2 (#216), Grok 4.1: 33.4 (#246)

Coding benchmarks
BenchmarkDeepSeek Coder 6.7BGrok 4.1
LMArena WebDev—1214
BigCodeBench Instruct35.5%—
LMArena Coding—1445
BigCodeBench Complete43.8%—
HumanEval+71.3%—
MBPP+65.6%—

Agentic & Tool Use Not comparable

DeepSeek Coder 6.7B: —, Grok 4.1: 33.8 (#47)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek Coder 6.7BGrok 4.1
Cybench—39%

Reasoning Not comparable

DeepSeek Coder 6.7B: —, Grok 4.1: 28.3 (#91)

Reasoning benchmarks
BenchmarkDeepSeek Coder 6.7BGrok 4.1
LMArena Hard Prompts—1436
Epoch Capabilities Index88.88—
WinoGrande57.6%—

Math Not comparable

DeepSeek Coder 6.7B: —, Grok 4.1: 36.2 (#124)

Math benchmarks
BenchmarkDeepSeek Coder 6.7BGrok 4.1
LMArena Math—1422
GSM8K21.3%—

Knowledge Not comparable

DeepSeek Coder 6.7B: —, Grok 4.1: 38.9 (#129)

Knowledge benchmarks
BenchmarkDeepSeek Coder 6.7BGrok 4.1
LMArena Expert—1417
ARC (AI2) Challenge36.4%—
MMLU36.4%—

Multilingual Not comparable

DeepSeek Coder 6.7B: —, Grok 4.1: 53.6 (#64)

Multilingual benchmarks
BenchmarkDeepSeek Coder 6.7BGrok 4.1
LMArena Non-English—1425
LMArena Chinese—1464
LMArena French—1448
LMArena German—1447
LMArena Japanese—1396
LMArena Korean—1407
LMArena Russian—1434
LMArena Spanish—1438

Instruction Following Not comparable

DeepSeek Coder 6.7B: —, Grok 4.1: 74.0 (#106)

Instruction Following benchmarks
BenchmarkDeepSeek Coder 6.7BGrok 4.1
LMArena Instruction Following—1400

Long Context Not comparable

DeepSeek Coder 6.7B: —, Grok 4.1: 43.2 (#96)

Long Context benchmarks
BenchmarkDeepSeek Coder 6.7BGrok 4.1
LMArena Longer Query—1416

Writing & Preference Not comparable

DeepSeek Coder 6.7B: —, Grok 4.1: 62.6 (#71)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 6.7BGrok 4.1
LMArena Text—1437
LMArena Creative Writing—1411
LMArena Multi-Turn—1438

Frequently asked questions

Is DeepSeek Coder 6.7B better than Grok 4.1?

Grok 4.1 has enough public results to be ranked (#135); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 6.7B or Grok 4.1 better for coding?

DeepSeek Coder 6.7B scores higher on coding benchmarks: 35.2 versus 33.4 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 6.7B and Grok 4.1 share?

0 benchmarks have published results for both models. DeepSeek Coder 6.7B has 9 scored results on Noometry and Grok 4.1 has 19.

Related comparisons

Go deeper