Model comparison

DeepSeek LLM 67B vs Gemini 3.1 Flash Lite

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 24.9 on the Noometry Index.

Last verified . 14 shared benchmarks.

DeepSeek LLM 67B DeepSeek

24.9

Rank #347 Confirmed

Gemini 3.1 Flash Lite Google

40.8

Rank #144 Confirmed

Summary

  • They share 14 benchmarks with published results for both. DeepSeek LLM 67B scores higher in 0 categories and Gemini 3.1 Flash Lite in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.1 Flash Lite leads 41.9 to 7.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 0.8% for DeepSeek LLM 67B and 80% for Gemini 3.1 Flash Lite.
  • DeepSeek LLM 67B has downloadable open weights; the other is API-only.

Side by side

DeepSeek LLM 67B and Gemini 3.1 Flash Lite specifications
DeepSeek LLM 67BGemini 3.1 Flash Lite
ProviderDeepSeekGoogle
Noometry Index24.940.8
Released2023-11-292026-03-03
WeightsOpenProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.25
Output $ / M tokens—$1.50
Results tracked1538

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.1 Flash Lite leads

DeepSeek LLM 67B: 31.9 (#278), Gemini 3.1 Flash Lite: 37.8 (#188)

Coding benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
LMArena Coding10961400
LMArena WebDev—1256
SciCode—41.9%
WeirdML—52.2%
ALE-Bench—797.73

Agentic & Tool Use Not comparable

DeepSeek LLM 67B: —, Gemini 3.1 Flash Lite: 30.2 (#79)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
DeepResearch Bench—37.3%

Reasoning Gemini 3.1 Flash Lite leads

DeepSeek LLM 67B: 16.5 (#304), Gemini 3.1 Flash Lite: 22.9 (#186)

Reasoning benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
Chess Puzzles0%25%
LMArena Hard Prompts10701407
Epoch Capabilities Index110.5144.47
Kagi LLM Benchmark—67.2%
NYT Connections (extended)—8.2%
CritPt—1.1%
EnigmaEval—3%
Thematic Generalization—63.3%
DTBench—76.8%
LMCA—35%
ForecastBench—54.4

Math Gemini 3.1 Flash Lite leads

DeepSeek LLM 67B: 8.7 (#324), Gemini 3.1 Flash Lite: 40.7 (#90)

Math benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
OTIS Mock AIME 2024-20250.8%80%
LMArena Math11081428
FrontierMath (Tiers 1-3)—27.7%
MATH Level 56.4%—

Knowledge Gemini 3.1 Flash Lite leads

DeepSeek LLM 67B: 7.0 (#313), Gemini 3.1 Flash Lite: 41.9 (#104)

Knowledge benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
GPQA Diamond24.6%81.8%
Humanity's Last Exam—8.6%
Vectara Hallucination Rate—8.2%
LMArena Expert—1398

Multimodal Not comparable

DeepSeek LLM 67B: —, Gemini 3.1 Flash Lite: 39.4 (#60)

Multimodal benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
LMArena Vision—1240

Multilingual Gemini 3.1 Flash Lite leads

DeepSeek LLM 67B: 29.4 (#267), Gemini 3.1 Flash Lite: 52.3 (#86)

Multilingual benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
LMArena Non-English10731411
LMArena Chinese11321461
LMArena French—1424
LMArena German—1429
LMArena Japanese—1413
LMArena Korean—1392
LMArena Russian—1420
LMArena Spanish—1421

Instruction Following Gemini 3.1 Flash Lite leads

DeepSeek LLM 67B: 55.4 (#277), Gemini 3.1 Flash Lite: 72.7 (#131)

Instruction Following benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
LMArena Instruction Following10791377

Long Context Gemini 3.1 Flash Lite leads

DeepSeek LLM 67B: 33.1 (#265), Gemini 3.1 Flash Lite: 42.5 (#122)

Long Context benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
LMArena Longer Query10921394

Writing & Preference Gemini 3.1 Flash Lite leads

DeepSeek LLM 67B: 31.6 (#282), Gemini 3.1 Flash Lite: 60.9 (#94)

Writing & Preference benchmarks
BenchmarkDeepSeek LLM 67BGemini 3.1 Flash Lite
LMArena Text11051416
LMArena Creative Writing10671401
LMArena Multi-Turn10821417

Frequently asked questions

Is DeepSeek LLM 67B better than Gemini 3.1 Flash Lite?

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 24.9 on the Noometry Index.

Is DeepSeek LLM 67B or Gemini 3.1 Flash Lite better for coding?

Gemini 3.1 Flash Lite scores higher on coding benchmarks: 37.8 versus 31.9 in the Noometry coding category.

How many benchmarks do DeepSeek LLM 67B and Gemini 3.1 Flash Lite share?

14 benchmarks have published results for both models. DeepSeek LLM 67B has 15 scored results on Noometry and Gemini 3.1 Flash Lite has 38.

Related comparisons

Go deeper