Model comparison

Gemini 2.5 Deep Think vs Gemini 3.1 Pro Preview

Gemini 3.1 Pro Preview has enough public results to be ranked (#20); Gemini 2.5 Deep Think does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Gemini 3.1 Pro Preview Google

56.7

Rank #20 Confirmed

Summary

  • They share 2 benchmarks with published results for both.

Side by side

Gemini 2.5 Deep Think and Gemini 3.1 Pro Preview specifications
Gemini 2.5 Deep ThinkGemini 3.1 Pro Preview
ProviderGoogleGoogle
Noometry Index—56.7
Released2025-08-012026-02-19
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$2
Output $ / M tokens—$12
Results tracked271

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 42.7 (#88)

Coding benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
SWE-bench Verified—75.6%
DeepSWE—11.7%
LMArena WebDev—1446
SciCode—58.9%
GSO—22.6%
WeirdML—72.1%
LMArena Coding—1483
MirrorCode—8.9%
ALE-Bench—1,161
AlgoTune—2.02

Agentic & Tool Use Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 37.7 (#33)

Agentic & Tool Use benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
Terminal-Bench—80.2%
APEX-Agents—35.3%
τ²-bench Banking—26%
DeepResearch Bench—47.8%
PostTrainBench—22%
BALROG—57%
ExploitBench—26.1%
GBAEval—0.8%
GDP.pdf—17%
LMArena Search—1211
METR Time Horizons—77%
Vending-Bench 2—3,774

Reasoning Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 71.7 (#9)

Reasoning benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
ARC-AGI-2—77.1%
SimpleBench—79.6%
NYT Connections (extended)—97.4%
ARC-AGI-1—98%
CritPt—17.7%
Chess Puzzles—55%
EnigmaEval—36.8%
Thematic Generalization—79.4%
EBR-Bench—14.3%
LMArena Hard Prompts—1484
Mystery Game Puzzles—34%
DTBench—97.1%
LMCA—53.8%
Epoch Capabilities Index—154.92
ForecastBench—59

Math Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 61.8 (#28)

Math benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
FrontierMath (Feb 2025 set)29%36.9%
FrontierMath Tier 4 (v1)10.4%16.7%
FrontierMath (Tiers 1-3)—59.6%
FrontierMath Tier 4—26.8%
MathArena Final-Answer Competitions—86.5%
OTIS Mock AIME 2024-2025—95.6%
ProofBench—26%
LMArena Math—1485

Knowledge Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 71.8 (#3)

Knowledge benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
GPQA Diamond—94.4%
Humanity's Last Exam—46.4%
SimpleQA Verified—73.5%
Vectara Hallucination Rate—10.4%
LMArena Expert—1484

Multimodal Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 38.1 (#60)

Multimodal benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
LMArena Vision—1296
Blueprint-Bench 2—26.5%
Furniture Assembly—26.7%
LMArena Document—1444

Multilingual Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 57.1 (#11)

Multilingual benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
LMArena Non-English—1475
LMArena Chinese—1528
LMArena French—1488
LMArena German—1491
LMArena Japanese—1494
LMArena Korean—1458
LMArena Russian—1496
LMArena Spanish—1480

Instruction Following Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 77.1 (#31)

Instruction Following benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
LMArena Instruction Following—1465

Long Context Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 47.3 (#17)

Long Context benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
CL-bench—20.8%
CL-bench Life—16.9%
LMArena Longer Query—1482

Writing & Preference Not comparable

Gemini 2.5 Deep Think: —, Gemini 3.1 Pro Preview: 66.3 (#36)

Writing & Preference benchmarks
BenchmarkGemini 2.5 Deep ThinkGemini 3.1 Pro Preview
LMArena Text—1480
LMArena Creative Writing—1482
EQ-Bench Creative Writing—1491
EQ-Bench 4—1142
LMArena Multi-Turn—1486

Frequently asked questions

Is Gemini 2.5 Deep Think better than Gemini 3.1 Pro Preview?

Gemini 3.1 Pro Preview has enough public results to be ranked (#20); Gemini 2.5 Deep Think does not yet, so treat this comparison as directional.

How many benchmarks do Gemini 2.5 Deep Think and Gemini 3.1 Pro Preview share?

2 benchmarks have published results for both models. Gemini 2.5 Deep Think has 2 scored results on Noometry and Gemini 3.1 Pro Preview has 71.

Related comparisons

Go deeper