Noometry

Model comparison

Gemini Advanced 0514 vs GPT-4 Turbo

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 30.5 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

GPT-4 Turbo OpenAI

30.5

Rank #292 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 7 categories and GPT-4 Turbo in 1 category; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini Advanced 0514 leads 35.5 to 9.0.

Side by side

Gemini Advanced 0514GPT-4 Turbo
ProviderGoogleOpenAI
Noometry Index37.730.5
Released—2023-11-06
WeightsProprietaryProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$10
Output $ / M tokens—$30
Results tracked1736

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.6 (#205), GPT-4 Turbo: 33.8 (#249)

BenchmarkGemini Advanced 0514GPT-4 Turbo
LMArena Coding12551268
WeirdML—18%
BigCodeBench Instruct—48.2%
BigCodeBench Complete—58.2%
HumanEval+—86.6%
MBPP+—73.3%

Agentic & Tool Use Not comparable

Gemini Advanced 0514: —, GPT-4 Turbo: —

BenchmarkGemini Advanced 0514GPT-4 Turbo
METR Time Horizons—36.7%

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), GPT-4 Turbo: 15.3 (#317)

BenchmarkGemini Advanced 0514GPT-4 Turbo
LMArena Hard Prompts12481251
SimpleBench—25.1%
Chess Puzzles—6%
DTBench—61.6%
LMCA—9.8%
Epoch Capabilities Index—127.25
ForecastBench—59.4

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), GPT-4 Turbo: 9.0 (#322)

BenchmarkGemini Advanced 0514GPT-4 Turbo
LMArena Math12721272
FrontierMath (Tiers 1-3)—0.7%
OTIS Mock AIME 2024-2025—6.7%
MATH Level 5—46.7%

Knowledge Gemini Advanced 0514 leads

Gemini Advanced 0514: 33.3 (#205), GPT-4 Turbo: 24.3 (#268)

BenchmarkGemini Advanced 0514GPT-4 Turbo
LMArena Expert12151223
GPQA Diamond—46.6%
Confabulations—28.4%
MMLU—81.3%

Multimodal Not comparable

Gemini Advanced 0514: —, GPT-4 Turbo: 30.6 (#110)

BenchmarkGemini Advanced 0514GPT-4 Turbo
LMArena Vision—1090

Multilingual Gemini Advanced 0514 leads

Gemini Advanced 0514: 42.6 (#192), GPT-4 Turbo: 40.5 (#216)

BenchmarkGemini Advanced 0514GPT-4 Turbo
LMArena Non-English12741245
LMArena Chinese12741242
LMArena French13071276
LMArena German12751259
LMArena Japanese12421194
LMArena Korean12321187
LMArena Russian12831259
LMArena Spanish12421260

Instruction Following Too close to call

Gemini Advanced 0514: 66.0 (#212), GPT-4 Turbo: 65.8 (#216)

BenchmarkGemini Advanced 0514GPT-4 Turbo
LMArena Instruction Following12531249

Long Context Too close to call

Gemini Advanced 0514: 38.0 (#207), GPT-4 Turbo: 38.0 (#206)

BenchmarkGemini Advanced 0514GPT-4 Turbo
LMArena Longer Query12531254

Writing & Preference Too close to call

Gemini Advanced 0514: 48.5 (#200), GPT-4 Turbo: 47.7 (#206)

BenchmarkGemini Advanced 0514GPT-4 Turbo
LMArena Text12791272
LMArena Creative Writing12841269
LMArena Multi-Turn12691267

Frequently asked questions

Is Gemini Advanced 0514 better than GPT-4 Turbo?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 30.5 on the Noometry Index.

Is Gemini Advanced 0514 or GPT-4 Turbo better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 33.8 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and GPT-4 Turbo share?

17 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and GPT-4 Turbo has 36.

Related comparisons

Go deeper