Model comparison

DeepSeek Coder 6.7B vs Gemini Advanced 0514

Gemini Advanced 0514 has enough public results to be ranked (#197); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

DeepSeek Coder 6.7B DeepSeek

37.6

Unranked Sparse

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Summary

  • DeepSeek Coder 6.7B has downloadable open weights; the other is API-only.

Side by side

DeepSeek Coder 6.7B and Gemini Advanced 0514 specifications
DeepSeek Coder 6.7BGemini Advanced 0514
ProviderDeepSeekGoogle
Noometry Index37.637.7
Released2023-11-02—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked917

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

DeepSeek Coder 6.7B: 35.8 (#219), Gemini Advanced 0514: 36.6 (#205)

Coding benchmarks
BenchmarkDeepSeek Coder 6.7BGemini Advanced 0514
BigCodeBench Instruct35.5%—
LMArena Coding—1255
BigCodeBench Complete43.8%—
HumanEval+71.3%—
MBPP+65.6%—

Reasoning Not comparable

DeepSeek Coder 6.7B: —, Gemini Advanced 0514: 24.6 (#160)

Reasoning benchmarks
BenchmarkDeepSeek Coder 6.7BGemini Advanced 0514
LMArena Hard Prompts—1248
Epoch Capabilities Index89.62—
WinoGrande57.6%—

Math Not comparable

DeepSeek Coder 6.7B: —, Gemini Advanced 0514: 35.5 (#181)

Math benchmarks
BenchmarkDeepSeek Coder 6.7BGemini Advanced 0514
LMArena Math—1272
GSM8K21.3%—

Knowledge Not comparable

DeepSeek Coder 6.7B: —, Gemini Advanced 0514: 33.3 (#205)

Knowledge benchmarks
BenchmarkDeepSeek Coder 6.7BGemini Advanced 0514
LMArena Expert—1215
ARC (AI2) Challenge36.4%—
MMLU36.4%—

Multilingual Not comparable

DeepSeek Coder 6.7B: —, Gemini Advanced 0514: 42.6 (#192)

Multilingual benchmarks
BenchmarkDeepSeek Coder 6.7BGemini Advanced 0514
LMArena Non-English—1274
LMArena Chinese—1274
LMArena French—1307
LMArena German—1275
LMArena Japanese—1242
LMArena Korean—1232
LMArena Russian—1283
LMArena Spanish—1242

Instruction Following Not comparable

DeepSeek Coder 6.7B: —, Gemini Advanced 0514: 66.0 (#212)

Instruction Following benchmarks
BenchmarkDeepSeek Coder 6.7BGemini Advanced 0514
LMArena Instruction Following—1253

Long Context Not comparable

DeepSeek Coder 6.7B: —, Gemini Advanced 0514: 38.0 (#207)

Long Context benchmarks
BenchmarkDeepSeek Coder 6.7BGemini Advanced 0514
LMArena Longer Query—1253

Writing & Preference Not comparable

DeepSeek Coder 6.7B: —, Gemini Advanced 0514: 48.5 (#200)

Writing & Preference benchmarks
BenchmarkDeepSeek Coder 6.7BGemini Advanced 0514
LMArena Text—1279
LMArena Creative Writing—1284
LMArena Multi-Turn—1269

Frequently asked questions

Is DeepSeek Coder 6.7B better than Gemini Advanced 0514?

Gemini Advanced 0514 has enough public results to be ranked (#197); DeepSeek Coder 6.7B does not yet, so treat this comparison as directional.

Is DeepSeek Coder 6.7B or Gemini Advanced 0514 better for coding?

They score almost the same on coding (35.8 vs 36.6); test both on your own repository before choosing.

How many benchmarks do DeepSeek Coder 6.7B and Gemini Advanced 0514 share?

0 benchmarks have published results for both models. DeepSeek Coder 6.7B has 9 scored results on Noometry and Gemini Advanced 0514 has 17.

Related comparisons

Go deeper