Noometry

Model comparison

DeepSeek LLM 67B vs Gemini 3.7 Flash

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 24.9 on the Noometry Index.

Last verified . 14 shared benchmarks.

DeepSeek LLM 67B DeepSeek

24.9

Rank #347 Confirmed

Gemini 3.7 Flash Google

59.8

Rank #14 Confirmed

Summary

  • They share 14 benchmarks with published results for both. DeepSeek LLM 67B scores higher in 0 categories and Gemini 3.7 Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.7 Flash leads 69.7 to 7.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 0.8% for DeepSeek LLM 67B and 97.2% for Gemini 3.7 Flash.
  • DeepSeek LLM 67B has downloadable open weights; the other is API-only.

Side by side

DeepSeek LLM 67BGemini 3.7 Flash
ProviderDeepSeekGoogle
Noometry Index24.959.8
Released2023-11-292026-08-13
WeightsOpenProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.75
Output $ / M tokens—$3.75
Results tracked1544

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.7 Flash leads

DeepSeek LLM 67B: 31.9 (#278), Gemini 3.7 Flash: 56.2 (#22)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
LMArena Coding10961497
DeepSWE—65.5%
FrontierCode—43.6%
LMArena WebDev—1592
FrontierSWE—20.3%
SciCode—59.8%
ALE-Bench—904.3

Agentic & Tool Use Not comparable

DeepSeek LLM 67B: —, Gemini 3.7 Flash: 42.1 (#19)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
APEX-Agents—67.8%
Remote Labor Index—5%
GDP.pdf—23.8%

Reasoning Gemini 3.7 Flash leads

DeepSeek LLM 67B: 16.5 (#304), Gemini 3.7 Flash: 70.0 (#15)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
Chess Puzzles0%47%
LMArena Hard Prompts10701494
Epoch Capabilities Index110.5157.27
ARC-AGI-2—84.6%
NYT Connections (extended)—94%
ARC-AGI-1—95.5%
CritPt—14.3%
Mystery Game Puzzles—37%
DTBench—96.8%
LMCA—50.4%

Math Gemini 3.7 Flash leads

DeepSeek LLM 67B: 8.7 (#324), Gemini 3.7 Flash: 69.6 (#23)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
OTIS Mock AIME 2024-20250.8%97.2%
LMArena Math11081507
FrontierMath (Tiers 1-3)—71.6%
FrontierMath Tier 4—36.6%
ProofBench—58%
MATH Level 56.4%—

Knowledge Gemini 3.7 Flash leads

DeepSeek LLM 67B: 7.0 (#313), Gemini 3.7 Flash: 69.7 (#5)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
GPQA Diamond24.6%94.8%
SimpleQA Verified—69.2%
LMArena Expert—1508

Multimodal Not comparable

DeepSeek LLM 67B: —, Gemini 3.7 Flash: 37.3 (#73)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
LMArena Vision—1316
Furniture Assembly—26.7%

Multilingual Gemini 3.7 Flash leads

DeepSeek LLM 67B: 29.4 (#267), Gemini 3.7 Flash: 57.6 (#7)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
LMArena Non-English10731484
LMArena Chinese11321548
LMArena French—1505
LMArena German—1498
LMArena Japanese—1512
LMArena Korean—1483
LMArena Russian—1516
LMArena Spanish—1503

Instruction Following Gemini 3.7 Flash leads

DeepSeek LLM 67B: 55.4 (#277), Gemini 3.7 Flash: 77.7 (#15)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
LMArena Instruction Following10791483

Long Context Gemini 3.7 Flash leads

DeepSeek LLM 67B: 33.1 (#265), Gemini 3.7 Flash: 45.7 (#30)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
LMArena Longer Query10921492

Writing & Preference Gemini 3.7 Flash leads

DeepSeek LLM 67B: 31.6 (#282), Gemini 3.7 Flash: 71.2 (#20)

BenchmarkDeepSeek LLM 67BGemini 3.7 Flash
LMArena Text11051486
LMArena Creative Writing10671490
LMArena Multi-Turn10821489
EQ-Bench Creative Writing—1723

Frequently asked questions

Is DeepSeek LLM 67B better than Gemini 3.7 Flash?

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 24.9 on the Noometry Index.

Is DeepSeek LLM 67B or Gemini 3.7 Flash better for coding?

Gemini 3.7 Flash scores higher on coding benchmarks: 56.2 versus 31.9 in the Noometry coding category.

How many benchmarks do DeepSeek LLM 67B and Gemini 3.7 Flash share?

14 benchmarks have published results for both models. DeepSeek LLM 67B has 15 scored results on Noometry and Gemini 3.7 Flash has 44.

Related comparisons

Go deeper