Model comparison

DeepSeek Coder 33B vs Gemini Advanced 0514

Gemini Advanced 0514 has enough public results to be ranked (#197); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

DeepSeek Coder 33B DeepSeek

38.9

Unranked Sparse

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Summary

  • DeepSeek Coder 33B has downloadable open weights; the other is API-only.

Side by side

DeepSeek Coder 33B and Gemini Advanced 0514 specifications
DeepSeek Coder 33BGemini Advanced 0514
ProviderDeepSeekGoogle
Noometry Index38.937.7
Released2023-11-02—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked917

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek Coder 33B leads

DeepSeek Coder 33B: 38.0 (#184), Gemini Advanced 0514: 36.6 (#205)

Coding benchmarks
BenchmarkDeepSeek Coder 33BGemini Advanced 0514
BigCodeBench Instruct42%—
LMArena Coding—1255
BigCodeBench Complete51.1%—
HumanEval+75%—
MBPP+70.1%—

Reasoning Not comparable

DeepSeek Coder 33B: —, Gemini Advanced 0514: 24.6 (#160)

Reasoning benchmarks
BenchmarkDeepSeek Coder 33BGemini Advanced 0514
LMArena Hard Prompts—1248
Epoch Capabilities Index96.32—
WinoGrande62%—

Math Not comparable

DeepSeek Coder 33B: —, Gemini Advanced 0514: 35.5 (#181)

Math benchmarks
BenchmarkDeepSeek Coder 33BGemini Advanced 0514
LMArena Math—1272
GSM8K35.4%—

Knowledge Not comparable

DeepSeek Coder 33B: —, Gemini Advanced 0514: 33.3 (#205)

Knowledge benchmarks
BenchmarkDeepSeek Coder 33BGemini Advanced 0514
LMArena Expert—1215
ARC (AI2) Challenge42.2%—
MMLU39.4%—

Multilingual Not comparable

DeepSeek Coder 33B: —, Gemini Advanced 0514: 42.6 (#192)

Multilingual benchmarks
BenchmarkDeepSeek Coder 33BGemini Advanced 0514
LMArena Non-English—1274
LMArena Chinese—1274
LMArena French—1307
LMArena German—1275
LMArena Japanese—1242
LMArena Korean—1232
LMArena Russian—1283
LMArena Spanish—1242

Instruction Following Not comparable

DeepSeek Coder 33B: —, Gemini Advanced 0514: 66.0 (#212)

Instruction Following benchmarks
BenchmarkDeepSeek Coder 33BGemini Advanced 0514
LMArena Instruction Following—1253

Long Context Not comparable

DeepSeek Coder 33B: —, Gemini Advanced 0514: 38.0 (#207)

Long Context benchmarks
BenchmarkDeepSeek Coder 33BGemini Advanced 0514
LMArena Longer Query—1253

Writing & Preference Not comparable

DeepSeek Coder 33B: —, Gemini Advanced 0514: 48.5 (#200)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 33BGemini Advanced 0514
LMArena Text—1279
LMArena Creative Writing—1284
LMArena Multi-Turn—1269

Frequently asked questions

Is DeepSeek Coder 33B better than Gemini Advanced 0514?

Gemini Advanced 0514 has enough public results to be ranked (#197); DeepSeek Coder 33B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 33B or Gemini Advanced 0514 better for coding?

DeepSeek Coder 33B scores higher on coding benchmarks: 38.0 versus 36.6 in the Noometry coding category.

How many benchmarks do DeepSeek Coder 33B and Gemini Advanced 0514 share?

0 benchmarks have published results for both models. DeepSeek Coder 33B has 9 scored results on Noometry and Gemini Advanced 0514 has 17.

Related comparisons

Go deeper