Model comparison

DeepSeek-R1-Distill-Qwen-1.5B vs Gemini 3.1 Pro Preview

Gemini 3.1 Pro Preview is the stronger model overall, scoring 56.7 to 26.1 on the Noometry Index.

Last verified . 3 shared benchmarks.

Gemini 3.1 Pro Preview Google

56.7

Rank #23 Confirmed

Summary

  • They share 3 benchmarks with published results for both. DeepSeek-R1-Distill-Qwen-1.5B scores higher in 0 categories and Gemini 3.1 Pro Preview in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.1 Pro Preview leads 71.8 to 16.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 21.4% for DeepSeek-R1-Distill-Qwen-1.5B and 95.6% for Gemini 3.1 Pro Preview.
  • DeepSeek-R1-Distill-Qwen-1.5B has downloadable open weights; the other is API-only.

Side by side

DeepSeek-R1-Distill-Qwen-1.5B and Gemini 3.1 Pro Preview specifications
DeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
ProviderDeepSeekGoogle
Noometry Index26.156.7
Released2025-01-202026-02-19
WeightsOpenProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$2
Output $ / M tokens—$12
Results tracked571

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.1 Pro Preview leads

DeepSeek-R1-Distill-Qwen-1.5B: 21.8 (#336), Gemini 3.1 Pro Preview: 42.5 (#99)

Coding benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
SWE-bench Verified—75.6%
DeepSWE—11.7%
LMArena WebDev—1447
SciCode—58.9%
GSO—22.6%
WeirdML—72.1%
BigCodeBench Instruct7%—
LMArena Coding—1484
MirrorCode—8.9%
BigCodeBench Complete7.9%—
ALE-Bench—1,161
AlgoTune—2.02

Agentic & Tool Use Not comparable

DeepSeek-R1-Distill-Qwen-1.5B: —, Gemini 3.1 Pro Preview: 37.7 (#34)

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
Terminal-Bench—80.2%
APEX-Agents—35.3%
τ²-bench Banking—26%
DeepResearch Bench—47.8%
PostTrainBench—22%
BALROG—57%
ExploitBench—26.1%
GBAEval—0.8%
GDP.pdf—17%
LMArena Search—1211
METR Time Horizons—77%
Vending-Bench 2—3,774

Reasoning Gemini 3.1 Pro Preview leads

DeepSeek-R1-Distill-Qwen-1.5B: 19.2 (#262), Gemini 3.1 Pro Preview: 71.7 (#12)

Reasoning benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
Chess Puzzles0%55%
ARC-AGI-2—77.1%
SimpleBench—79.6%
NYT Connections (extended)—97.4%
ARC-AGI-1—98%
CritPt—17.7%
EnigmaEval—36.8%
Thematic Generalization—79.4%
EBR-Bench—14.3%
LMArena Hard Prompts—1485
Mystery Game Puzzles—34%
DTBench—97.1%
LMCA—53.8%
Epoch Capabilities Index—154.77
ForecastBench—59

Math Gemini 3.1 Pro Preview leads

DeepSeek-R1-Distill-Qwen-1.5B: 23.0 (#274), Gemini 3.1 Pro Preview: 62.1 (#34)

Math benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
OTIS Mock AIME 2024-202521.4%95.6%
FrontierMath (Tiers 1-3)—59.6%
FrontierMath Tier 4—26.8%
MathArena Final-Answer Competitions—86.5%
ProofBench—26%
LMArena Math—1485
FrontierMath (Feb 2025 set)—36.9%
FrontierMath Tier 4 (v1)—16.7%

Knowledge Gemini 3.1 Pro Preview leads

DeepSeek-R1-Distill-Qwen-1.5B: 16.0 (#290), Gemini 3.1 Pro Preview: 71.8 (#3)

Knowledge benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
GPQA Diamond33.6%94.4%
Humanity's Last Exam—46.4%
SimpleQA Verified—73.5%
Vectara Hallucination Rate—10.4%
LMArena Expert—1485

Multimodal Not comparable

DeepSeek-R1-Distill-Qwen-1.5B: —, Gemini 3.1 Pro Preview: 37.9 (#69)

Multimodal benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
LMArena Vision—1296
Blueprint-Bench 2—26.5%
Furniture Assembly—26.7%
LMArena Document—1444

Multilingual Not comparable

DeepSeek-R1-Distill-Qwen-1.5B: —, Gemini 3.1 Pro Preview: 57.0 (#12)

Multilingual benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
LMArena Non-English—1477
LMArena Chinese—1529
LMArena French—1487
LMArena German—1491
LMArena Japanese—1493
LMArena Korean—1455
LMArena Russian—1498
LMArena Spanish—1479

Instruction Following Not comparable

DeepSeek-R1-Distill-Qwen-1.5B: —, Gemini 3.1 Pro Preview: 77.0 (#32)

Instruction Following benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
LMArena Instruction Following—1466

Long Context Not comparable

DeepSeek-R1-Distill-Qwen-1.5B: —, Gemini 3.1 Pro Preview: 47.4 (#18)

Long Context benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
CL-bench—20.8%
CL-bench Life—16.9%
LMArena Longer Query—1483

Writing & Preference Not comparable

DeepSeek-R1-Distill-Qwen-1.5B: —, Gemini 3.1 Pro Preview: 66.1 (#37)

Writing & Preference benchmarks
BenchmarkDeepSeek-R1-Distill-Qwen-1.5BGemini 3.1 Pro Preview
LMArena Text—1481
LMArena Creative Writing—1482
EQ-Bench Creative Writing—1491
EQ-Bench 4—1142
LMArena Multi-Turn—1488

Frequently asked questions

Is DeepSeek-R1-Distill-Qwen-1.5B better than Gemini 3.1 Pro Preview?

Gemini 3.1 Pro Preview is the stronger model overall, scoring 56.7 to 26.1 on the Noometry Index.

Is DeepSeek-R1-Distill-Qwen-1.5B or Gemini 3.1 Pro Preview better for coding?

Gemini 3.1 Pro Preview scores higher on coding benchmarks: 42.5 versus 21.8 in the Noometry coding category.

How many benchmarks do DeepSeek-R1-Distill-Qwen-1.5B and Gemini 3.1 Pro Preview share?

3 benchmarks have published results for both models. DeepSeek-R1-Distill-Qwen-1.5B has 5 scored results on Noometry and Gemini 3.1 Pro Preview has 71.

Related comparisons

Go deeper