Noometry

Model comparison

Gemini 3 Deep Think vs GPT-5.4

GPT-5.4 has enough public results to be ranked (#16); Gemini 3 Deep Think does not yet, so treat this comparison as directional.

Last verified . 3 shared benchmarks.

Gemini 3 Deep Think Google

58.3

Unranked Sparse

GPT-5.4 OpenAI

59.4

Rank #16 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Gemini 3 Deep Think scores higher in 1 category and GPT-5.4 in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Deep Think leads 70.2 to 61.8.
  • The biggest single-benchmark swing is ARC-AGI-2: 84.6% for Gemini 3 Deep Think and 74% for GPT-5.4.

Side by side

Gemini 3 Deep ThinkGPT-5.4
ProviderGoogleOpenAI
Noometry Index58.359.4
Released2026-02-122026-03-05
WeightsProprietaryProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$2.50
Output $ / M tokens—$15
Results tracked368

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 3 Deep Think: —, GPT-5.4: 52.6 (#33)

BenchmarkGemini 3 Deep ThinkGPT-5.4
SWE-bench Verified—76.9%
DeepSWE—51.8%
LMArena WebDev—1465
SciCode—56.6%
GSO—31.4%
WeirdML—77.7%
LMArena Coding—1497
MirrorCode—15.6%
ALE-Bench—1,607
AlgoTune—1.85

Agentic & Tool Use Not comparable

Gemini 3 Deep Think: —, GPT-5.4: 46.5 (#13)

BenchmarkGemini 3 Deep ThinkGPT-5.4
Terminal-Bench—81.8%
APEX-Agents—52.4%
τ²-bench Banking—39.4%
DeepResearch Bench—35.1%
PostTrainBench—19%
GBAEval—45.1%
LMArena Search—1197
METR Time Horizons—74.3%
Vending-Bench 2—6,144

Reasoning Gemini 3 Deep Think leads

Gemini 3 Deep Think: 70.2 (#14), GPT-5.4: 61.8 (#19)

BenchmarkGemini 3 Deep ThinkGPT-5.4
ARC-AGI-284.6%74%
ARC-AGI-196%93.7%
CritPt25.7%23.4%
Kagi LLM Benchmark—63.8%
NYT Connections (extended)—91.3%
Chess Puzzles—44%
EnigmaEval—16%
Thematic Generalization—80%
EBR-Bench—25.4%
LMArena Hard Prompts—1485
Mystery Game Puzzles—37%
DTBench—94.4%
LMCA—52%
Epoch Capabilities Index—156.81
ForecastBench—59.5

Math Not comparable

Gemini 3 Deep Think: —, GPT-5.4: 73.5 (#19)

BenchmarkGemini 3 Deep ThinkGPT-5.4
FrontierMath (Tiers 1-3)—78.6%
FrontierMath Tier 4—49%
MathArena Final-Answer Competitions—83.1%
OTIS Mock AIME 2024-2025—97.8%
ProofBench—56%
LMArena Math—1488
FrontierMath (Feb 2025 set)—47.6%
FrontierMath Tier 4 (v1)—27.1%

Knowledge Not comparable

Gemini 3 Deep Think: —, GPT-5.4: 65.3 (#14)

BenchmarkGemini 3 Deep ThinkGPT-5.4
GPQA Diamond—93.3%
Humanity's Last Exam—36.2%
SimpleQA Verified—45.1%
Vectara Hallucination Rate—7%
LMArena Expert—1507

Multimodal Not comparable

Gemini 3 Deep Think: —, GPT-5.4: 43.7 (#20)

BenchmarkGemini 3 Deep ThinkGPT-5.4
LMArena Vision—1303
Blueprint-Bench 2—27.1%
Furniture Assembly—37.5%
LMArena Document—1471

Multilingual Not comparable

Gemini 3 Deep Think: —, GPT-5.4: 56.2 (#23)

BenchmarkGemini 3 Deep ThinkGPT-5.4
LMArena Non-English—1465
LMArena Chinese—1519
LMArena French—1493
LMArena German—1472
LMArena Japanese—1485
LMArena Korean—1448
LMArena Russian—1480
LMArena Spanish—1454

Instruction Following Not comparable

Gemini 3 Deep Think: —, GPT-5.4: 77.1 (#27)

BenchmarkGemini 3 Deep ThinkGPT-5.4
LMArena Instruction Following—1469

Long Context Not comparable

Gemini 3 Deep Think: —, GPT-5.4: 50.3 (#8)

BenchmarkGemini 3 Deep ThinkGPT-5.4
CL-bench—27.9%
CL-bench Life—21.7%
LMArena Longer Query—1473

Writing & Preference Not comparable

Gemini 3 Deep Think: —, GPT-5.4: 71.9 (#17)

BenchmarkGemini 3 Deep ThinkGPT-5.4
LMArena Text—1469
LMArena Creative Writing—1439
EQ-Bench Creative Writing—1840
EQ-Bench 4—1272
LMArena Multi-Turn—1482

Frequently asked questions

Is Gemini 3 Deep Think better than GPT-5.4?

GPT-5.4 has enough public results to be ranked (#16); Gemini 3 Deep Think does not yet, so treat this comparison as directional.

How many benchmarks do Gemini 3 Deep Think and GPT-5.4 share?

3 benchmarks have published results for both models. Gemini 3 Deep Think has 3 scored results on Noometry and GPT-5.4 has 68.

Related comparisons

Go deeper