Noometry

Model comparison

Gemini 1.0 Pro vs GPT-5

GPT-5 is the stronger model overall, scoring 50.9 to 27.3 on the Noometry Index.

Last verified . 21 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

GPT-5 OpenAI

50.9

Rank #45 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and GPT-5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5 leads 55.0 to 9.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemini 1.0 Pro and 91.4% for GPT-5.

Side by side

Gemini 1.0 ProGPT-5
ProviderGoogleOpenAI
Noometry Index27.350.9
Released2023-12-132025-08-07
WeightsProprietaryProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$1.25
Output $ / M tokens—$10
Results tracked2469

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 leads

Gemini 1.0 Pro: 32.2 (#275), GPT-5: 50.3 (#47)

BenchmarkGemini 1.0 ProGPT-5
LMArena Coding11081436
SWE-bench Verified—73.6%
SWE-bench Verified (bash only)—65%
Aider Polyglot—88%
LMArena WebDev—1418
SciCode—42.9%
GSO—6.9%
WeirdML—60.7%
ALE-Bench—1,162
AlgoTune—1.67
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, GPT-5: 33.1 (#56)

BenchmarkGemini 1.0 ProGPT-5
Terminal-Bench—49.6%
GDPval—34.8%
Remote Labor Index—1.7%
DeepResearch Bench—49.6%
BALROG—32.8%
LMArena Search—1133
METR Time Horizons—69.6%

Reasoning GPT-5 leads

Gemini 1.0 Pro: 17.1 (#296), GPT-5: 38.3 (#64)

BenchmarkGemini 1.0 ProGPT-5
LMArena Hard Prompts11091416
DTBench45.9%90.7%
Epoch Capabilities Index117.04150
ARC-AGI-2—9.9%
SimpleBench—56.7%
Kagi LLM Benchmark—72.7%
ARC-AGI-1—65.7%
CritPt—12.6%
Chess Puzzles—37%
EnigmaEval—10.5%
EBR-Bench—12.7%
Mystery Game Puzzles—23%
LMCA—40%
ForecastBench—61.4

Math GPT-5 leads

Gemini 1.0 Pro: 9.3 (#321), GPT-5: 55.0 (#44)

BenchmarkGemini 1.0 ProGPT-5
OTIS Mock AIME 2024-20251.1%91.4%
LMArena Math11321407
MATH Level 511.2%98.1%
FrontierMath (Tiers 1-3)—55.4%
FrontierMath Tier 4—22%
ProofBench—18%
Omni-MATH—64.7%
FrontierMath (Feb 2025 set)—32.4%
FrontierMath Tier 4 (v1)—12.5%

Knowledge GPT-5 leads

Gemini 1.0 Pro: 15.6 (#291), GPT-5: 56.6 (#43)

BenchmarkGemini 1.0 ProGPT-5
GPQA Diamond34%86.2%
LMArena Expert10591419
Humanity's Last Exam—25.3%
SimpleQA Verified—50.1%
MMLU-Pro—86.3%
Confabulations—10.3%
Vectara Hallucination Rate—14.7%
GPQA (HELM)—79.2%
MMLU70%—

Multimodal Not comparable

Gemini 1.0 Pro: —, GPT-5: 46.8 (#13)

BenchmarkGemini 1.0 ProGPT-5
LMArena Vision—1232
GeoBench—81%
VPCT—66%

Multilingual GPT-5 leads

Gemini 1.0 Pro: 33.4 (#252), GPT-5: 51.4 (#110)

BenchmarkGemini 1.0 ProGPT-5
LMArena Non-English11381397
LMArena Chinese11241422
LMArena French11451410
LMArena German11251416
LMArena Japanese10231409
LMArena Russian11861406
LMArena Spanish11191399
LMArena Korean—1360

Instruction Following GPT-5 leads

Gemini 1.0 Pro: 57.6 (#267), GPT-5: 73.8 (#113)

BenchmarkGemini 1.0 ProGPT-5
LMArena Instruction Following11141388
IFEval—87.5%

Long Context GPT-5 leads

Gemini 1.0 Pro: 34.3 (#249), GPT-5: 69.5 (#2)

BenchmarkGemini 1.0 ProGPT-5
LMArena Longer Query11321399
Fiction.LiveBench—97.2%

Writing & Preference GPT-5 leads

Gemini 1.0 Pro: 36.0 (#264), GPT-5: 63.4 (#65)

BenchmarkGemini 1.0 ProGPT-5
LMArena Text11491406
LMArena Creative Writing11311365
LMArena Multi-Turn11391426
Short-Story Creative Writing—86%
EQ-Bench Creative Writing—1627
WildBench—85.7%

Frequently asked questions

Is Gemini 1.0 Pro better than GPT-5?

GPT-5 is the stronger model overall, scoring 50.9 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or GPT-5 better for coding?

GPT-5 scores higher on coding benchmarks: 50.3 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and GPT-5 share?

21 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and GPT-5 has 69.

Related comparisons

Go deeper