Noometry

Model comparison

DeepSeek Coder 33B vs Grok-2 (Dec 2024)

Grok-2 (Dec 2024) has enough public results to be ranked (#239); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

DeepSeek Coder 33B DeepSeek

38.9

Unranked Sparse

Grok-2 (Dec 2024) xAI

33.7

Rank #239 Confirmed

Summary

  • They share 1 benchmark with published results for both. DeepSeek Coder 33B scores higher in 1 category and Grok-2 (Dec 2024) in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in coding, where DeepSeek Coder 33B leads 38.0 to 33.3.
  • DeepSeek Coder 33B has downloadable open weights; the other is API-only.

Side by side

DeepSeek Coder 33BGrok-2 (Dec 2024)
ProviderDeepSeekxAI
Noometry Index38.933.7
Released2023-11-022024-08-13
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked934

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek Coder 33B leads

DeepSeek Coder 33B: 38.0 (#184), Grok-2 (Dec 2024): 33.3 (#258)

BenchmarkDeepSeek Coder 33BGrok-2 (Dec 2024)
WeirdML—22.2%
BigCodeBench Instruct42%—
LiveBench Coding—46.4%
LMArena Coding—1287
BigCodeBench Complete51.1%—
HumanEval+75%—
MBPP+70.1%—

Reasoning Not comparable

DeepSeek Coder 33B: —, Grok-2 (Dec 2024): 16.9 (#299)

BenchmarkDeepSeek Coder 33BGrok-2 (Dec 2024)
Epoch Capabilities Index96.32130.48
SimpleBench—22.7%
LiveBench Reasoning—54.8%
LMArena Hard Prompts—1272
DTBench—65.2%
LiveBench Data Analysis—54.5%
LiveBench—54.3%
WinoGrande62%—

Math Not comparable

DeepSeek Coder 33B: —, Grok-2 (Dec 2024): 20.8 (#284)

BenchmarkDeepSeek Coder 33BGrok-2 (Dec 2024)
OTIS Mock AIME 2024-2025—11.5%
LiveBench Math—54.9%
LMArena Math—1283
MATH Level 5—63.5%
FrontierMath (Feb 2025 set)—0.7%
GSM8K35.4%—

Knowledge Not comparable

DeepSeek Coder 33B: —, Grok-2 (Dec 2024): 29.8 (#233)

BenchmarkDeepSeek Coder 33BGrok-2 (Dec 2024)
GPQA Diamond—53.8%
Confabulations—20.1%
LMArena Expert—1254
ARC (AI2) Challenge42.2%—
MMLU39.4%—

Multilingual Not comparable

DeepSeek Coder 33B: —, Grok-2 (Dec 2024): 43.1 (#188)

BenchmarkDeepSeek Coder 33BGrok-2 (Dec 2024)
LMArena Non-English—1282
LMArena Chinese—1289
LMArena French—1318
LMArena German—1287
LMArena Japanese—1244
LMArena Korean—1237
LMArena Russian—1286
LMArena Spanish—1281

Instruction Following Not comparable

DeepSeek Coder 33B: —, Grok-2 (Dec 2024): 66.9 (#202)

BenchmarkDeepSeek Coder 33BGrok-2 (Dec 2024)
LiveBench Instruction Following—69.6%
LMArena Instruction Following—1270

Long Context Not comparable

DeepSeek Coder 33B: —, Grok-2 (Dec 2024): 38.8 (#190)

BenchmarkDeepSeek Coder 33BGrok-2 (Dec 2024)
LMArena Longer Query—1276

Writing & Preference Not comparable

DeepSeek Coder 33B: —, Grok-2 (Dec 2024): 48.6 (#198)

BenchmarkDeepSeek Coder 33BGrok-2 (Dec 2024)
LMArena Text—1305
LMArena Creative Writing—1284
Short-Story Creative Writing—63.6%
LMArena Multi-Turn—1290
LiveBench Language—45.6%

Frequently asked questions

Is DeepSeek Coder 33B better than Grok-2 (Dec 2024)?

Grok-2 (Dec 2024) has enough public results to be ranked (#239); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 33B or Grok-2 (Dec 2024) better for coding?

DeepSeek Coder 33B scores higher on coding benchmarks: 38.0 versus 33.3 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 33B and Grok-2 (Dec 2024) share?

1 benchmark has published results for both models. DeepSeek Coder 33B has 9 scored results on Noometry and Grok-2 (Dec 2024) has 34.

Related comparisons

Go deeper