Noometry

Model comparison

Gemini Advanced 0514 vs GPT-5 Nano

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 33.5 on the Noometry Index.

Last verified . 16 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

GPT-5 Nano OpenAI

33.5

Rank #241 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 5 categories and GPT-5 Nano in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini Advanced 0514 leads 48.5 to 39.1.

Side by side

Gemini Advanced 0514GPT-5 Nano
ProviderGoogleOpenAI
Noometry Index37.733.5
Released—2025-08-07
WeightsProprietaryProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.40
Results tracked1749

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.6 (#205), GPT-5 Nano: 33.6 (#254)

BenchmarkGemini Advanced 0514GPT-5 Nano
LMArena Coding12551351
SWE-bench Verified (bash only)—34.8%
WeirdML—38.1%
ALE-Bench—718.67

Agentic & Tool Use Not comparable

Gemini Advanced 0514: —, GPT-5 Nano: 25.8 (#106)

BenchmarkGemini Advanced 0514GPT-5 Nano
Terminal-Bench—21.8%
Berkeley Function Calling Leaderboard—51.5%

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), GPT-5 Nano: 16.3 (#306)

BenchmarkGemini Advanced 0514GPT-5 Nano
LMArena Hard Prompts12481328
ARC-AGI-2—2.6%
Kagi LLM Benchmark—62.2%
ARC-AGI-1—20.7%
Chess Puzzles—27%
Mystery Game Puzzles—9%
DTBench—62.7%
LMCA—7.9%
Epoch Capabilities Index—139.38
ForecastBench—59.1

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), GPT-5 Nano: 29.4 (#241)

BenchmarkGemini Advanced 0514GPT-5 Nano
LMArena Math12721317
FrontierMath (Tiers 1-3)—20%
FrontierMath Tier 4—2.4%
OTIS Mock AIME 2024-2025—81.1%
ProofBench—12%
Omni-MATH—54.6%
MATH Level 5—95.2%
FrontierMath (Feb 2025 set)—8.3%
FrontierMath Tier 4 (v1)—2.1%

Knowledge GPT-5 Nano leads

Gemini Advanced 0514: 33.3 (#205), GPT-5 Nano: 35.9 (#178)

BenchmarkGemini Advanced 0514GPT-5 Nano
LMArena Expert12151321
GPQA Diamond—69.4%
SimpleQA Verified—11.7%
MMLU-Pro—77.8%
Vectara Hallucination Rate—10.5%
GPQA (HELM)—67.9%

Multimodal Not comparable

Gemini Advanced 0514: —, GPT-5 Nano: 31.3 (#108)

BenchmarkGemini Advanced 0514GPT-5 Nano
LMArena Vision—1159
VPCT—37.2%

Multilingual GPT-5 Nano leads

Gemini Advanced 0514: 42.6 (#192), GPT-5 Nano: 45.3 (#172)

BenchmarkGemini Advanced 0514GPT-5 Nano
LMArena Non-English12741313
LMArena Chinese12741356
LMArena German12751327
LMArena Japanese12421226
LMArena Korean12321269
LMArena Russian12831296
LMArena Spanish12421360
LMArena French1307—

Instruction Following GPT-5 Nano leads

Gemini Advanced 0514: 66.0 (#212), GPT-5 Nano: 75.0 (#79)

BenchmarkGemini Advanced 0514GPT-5 Nano
LMArena Instruction Following12531306
IFEval—93.2%

Long Context Gemini Advanced 0514 leads

Gemini Advanced 0514: 38.0 (#207), GPT-5 Nano: 31.3 (#281)

BenchmarkGemini Advanced 0514GPT-5 Nano
LMArena Longer Query12531312
Fiction.LiveBench—44.4%

Writing & Preference Gemini Advanced 0514 leads

Gemini Advanced 0514: 48.5 (#200), GPT-5 Nano: 39.1 (#249)

BenchmarkGemini Advanced 0514GPT-5 Nano
LMArena Text12791320
LMArena Creative Writing12841249
LMArena Multi-Turn12691311
EQ-Bench Creative Writing—705
WildBench—80.6%

Frequently asked questions

Is Gemini Advanced 0514 better than GPT-5 Nano?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 33.5 on the Noometry Index.

Is Gemini Advanced 0514 or GPT-5 Nano better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 33.6 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and GPT-5 Nano share?

16 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and GPT-5 Nano has 49.

Related comparisons

Go deeper