Model comparison

DeepSeek-V3 vs Gemini 2.5 Pro

Gemini 2.5 Pro is the stronger model overall, scoring 45.0 to 39.5 on the Noometry Index. DeepSeek-V3 costs 8.5× less per token, which makes it the better buy when Gemini 2.5 Pro's lead doesn't matter for your workload.

Last verified . 49 shared benchmarks.

DeepSeek-V3 DeepSeek

39.5

Rank #166 Confirmed

Gemini 2.5 Pro Google

45.0

Rank #75 Confirmed

Summary

  • They share 49 benchmarks with published results for both. DeepSeek-V3 scores higher in 0 categories and Gemini 2.5 Pro in 8 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in long context, where Gemini 2.5 Pro leads 59.8 to 34.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 37.8% for DeepSeek-V3 and 84.7% for Gemini 2.5 Pro.
  • DeepSeek-V3 is cheaper at $0.24 / $0.90 per million input/output tokens, against $1.25 / $10 for Gemini 2.5 Pro.
  • Gemini 2.5 Pro accepts more context: 1.05M tokens versus 164K.
  • DeepSeek-V3 has downloadable open weights; the other is API-only.

Side by side

DeepSeek-V3 and Gemini 2.5 Pro specifications
DeepSeek-V3Gemini 2.5 Pro
ProviderDeepSeekGoogle
Noometry Index39.545.0
Released2024-12-262025-03-25
WeightsOpenProprietary
Context window164K1.05M
Max output164K66K
Input $ / M tokens$0.24$1.25
Output $ / M tokens$0.90$10
Results tracked6078

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

DeepSeek-V3: 42.3 (#106), Gemini 2.5 Pro: 42.4 (#101)

Coding benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
Aider Polyglot55.1%83.1%
SciCode35.8%42.8%
WeirdML36.1%54%
LiveBench Coding70.9%85.9%
LMArena Coding13681452
SWE-bench Verified—57.6%
SWE-bench Verified (bash only)—53.6%
LMArena WebDev—1227
GSO—3.9%
BigCodeBench Instruct50%—
BigCodeBench Complete62.2%—
CadEval—64%
ALE-Bench—785.52
AlgoTune—1.51
HumanEval+86.6%—
MBPP+73%—

Agentic & Tool Use Not comparable

DeepSeek-V3: —, Gemini 2.5 Pro: 29.2 (#88)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
METR Time Horizons49.6%55.4%
Terminal-Bench—32.6%
GDPval—23.3%
Remote Labor Index—0.8%
TheAgentCompany—30.3%
τ²-bench Banking—13.7%
DeepResearch Bench—42.8%
BALROG—43.3%
LMArena Search—1142
Vending-Bench 2—573.64

Reasoning Gemini 2.5 Pro leads

DeepSeek-V3: 20.5 (#236), Gemini 2.5 Pro: 28.8 (#99)

Reasoning benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
SimpleBench27.2%62.4%
Kagi LLM Benchmark52.3%70.3%
CritPt0%2%
LiveBench Reasoning65.8%89.8%
LMArena Hard Prompts13651455
DTBench64.8%82.4%
LiveBench Data Analysis60.9%79.9%
LMCA15.5%34.8%
Epoch Capabilities Index135.94145.32
ForecastBench59.161.3
LiveBench66.9%82.3%
ARC-AGI-2—4.9%
ARC-AGI-1—41%
Chess Puzzles—20%
EnigmaEval—5.6%
BIG-Bench Hard87.5%—
HellaSwag88.9%—
PIQA84.7%—
WinoGrande85.2%—

Math Too close to call

DeepSeek-V3: 32.1 (#219), Gemini 2.5 Pro: 32.5 (#213)

Math benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
OTIS Mock AIME 2024-202537.8%84.7%
Omni-MATH40.3%41.6%
LiveBench Math73.5%90.2%
LMArena Math13731450
MATH Level 575.5%95.9%
FrontierMath (Feb 2025 set)1.7%14.1%
FrontierMath (Tiers 1-3)—24.6%
FrontierMath Tier 4—0%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Gemini 2.5 Pro leads

DeepSeek-V3: 37.5 (#155), Gemini 2.5 Pro: 56.0 (#46)

Knowledge benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
GPQA Diamond67.6%85.3%
MMLU-Pro72.3%86.3%
Confabulations26.1%10.6%
Vectara Hallucination Rate6.1%7%
GPQA (HELM)53.8%74.9%
LMArena Expert13511452
Humanity's Last Exam—21.6%
ARC (AI2) Challenge95.3%—
MMLU87.2%—
TriviaQA82.9%—

Multimodal Not comparable

DeepSeek-V3: —, Gemini 2.5 Pro: 45.2 (#18)

Multimodal benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
LMArena Vision—1263
GeoBench—86%
VPCT—48%
LMArena Document—1421
SpatialViz-Bench—44.7%

Multilingual Gemini 2.5 Pro leads

DeepSeek-V3: 48.5 (#143), Gemini 2.5 Pro: 55.3 (#31)

Multilingual benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
LMArena Non-English13581451
LMArena Chinese13911507
LMArena French13851472
LMArena German13741487
LMArena Japanese13331461
LMArena Korean13191434
LMArena Russian13731461
LMArena Spanish13581473

Instruction Following Gemini 2.5 Pro leads

DeepSeek-V3: 72.8 (#130), Gemini 2.5 Pro: 75.0 (#75)

Instruction Following benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
LiveBench Instruction Following81.5%80.6%
IFEval83.2%84%
LMArena Instruction Following13451437

Long Context Gemini 2.5 Pro leads

DeepSeek-V3: 34.0 (#253), Gemini 2.5 Pro: 59.8 (#5)

Long Context benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
Fiction.LiveBench50%91.7%
LMArena Longer Query13521449

Writing & Preference Gemini 2.5 Pro leads

DeepSeek-V3: 57.4 (#130), Gemini 2.5 Pro: 63.7 (#62)

Writing & Preference benchmarks
BenchmarkDeepSeek-V3Gemini 2.5 Pro
LMArena Text13751458
LMArena Creative Writing13641454
Short-Story Creative Writing77%83.8%
EQ-Bench Creative Writing14721421
WildBench83%85.7%
LMArena Multi-Turn13891453
LiveBench Language49.1%67.8%

Frequently asked questions

Is DeepSeek-V3 better than Gemini 2.5 Pro?

Gemini 2.5 Pro is the stronger model overall, scoring 45.0 to 39.5 on the Noometry Index. DeepSeek-V3 costs 8.5× less per token, which makes it the better buy when Gemini 2.5 Pro's lead doesn't matter for your workload.

Which is cheaper, DeepSeek-V3 or Gemini 2.5 Pro?

DeepSeek-V3 is cheaper. It lists at $0.24 per million input tokens and $0.90 per million output tokens; Gemini 2.5 Pro lists at $1.25 and $10.

Is DeepSeek-V3 or Gemini 2.5 Pro better for coding?

They score almost the same on coding (42.3 vs 42.4); test both on your own repository before choosing.

Which has the bigger context window?

Gemini 2.5 Pro does, with 1.05M tokens against 164K.

How many benchmarks do DeepSeek-V3 and Gemini 2.5 Pro share?

49 benchmarks have published results for both models. DeepSeek-V3 has 60 scored results on Noometry and Gemini 2.5 Pro has 78.

Related comparisons

Go deeper