Model comparison

Gemini 1.0 Pro vs Gemini Advanced 0514

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 27.3 on the Noometry Index.

Last verified . 16 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Gemini Advanced 0514 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini Advanced 0514 leads 35.5 to 9.3.

Side by side

Gemini 1.0 Pro and Gemini Advanced 0514 specifications
Gemini 1.0 ProGemini Advanced 0514
ProviderGoogleGoogle
Noometry Index27.337.7
Released2023-12-13—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2417

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini 1.0 Pro: 32.2 (#275), Gemini Advanced 0514: 36.6 (#205)

Coding benchmarks
BenchmarkGemini 1.0 ProGemini Advanced 0514
LMArena Coding11081255
HumanEval+55.5%—
MBPP+61.4%—

Reasoning Gemini Advanced 0514 leads

Gemini 1.0 Pro: 17.1 (#296), Gemini Advanced 0514: 24.6 (#160)

Reasoning benchmarks
BenchmarkGemini 1.0 ProGemini Advanced 0514
LMArena Hard Prompts11091248
DTBench45.9%—
Epoch Capabilities Index117.04—

Math Gemini Advanced 0514 leads

Gemini 1.0 Pro: 9.3 (#321), Gemini Advanced 0514: 35.5 (#181)

Math benchmarks
BenchmarkGemini 1.0 ProGemini Advanced 0514
LMArena Math11321272
OTIS Mock AIME 2024-20251.1%—
MATH Level 511.2%—

Knowledge Gemini Advanced 0514 leads

Gemini 1.0 Pro: 15.6 (#291), Gemini Advanced 0514: 33.3 (#205)

Knowledge benchmarks
BenchmarkGemini 1.0 ProGemini Advanced 0514
LMArena Expert10591215
GPQA Diamond34%—
MMLU70%—

Multilingual Gemini Advanced 0514 leads

Gemini 1.0 Pro: 33.4 (#252), Gemini Advanced 0514: 42.6 (#192)

Multilingual benchmarks
BenchmarkGemini 1.0 ProGemini Advanced 0514
LMArena Non-English11381274
LMArena Chinese11241274
LMArena French11451307
LMArena German11251275
LMArena Japanese10231242
LMArena Russian11861283
LMArena Spanish11191242
LMArena Korean—1232

Instruction Following Gemini Advanced 0514 leads

Gemini 1.0 Pro: 57.6 (#267), Gemini Advanced 0514: 66.0 (#212)

Instruction Following benchmarks
BenchmarkGemini 1.0 ProGemini Advanced 0514
LMArena Instruction Following11141253

Long Context Gemini Advanced 0514 leads

Gemini 1.0 Pro: 34.3 (#249), Gemini Advanced 0514: 38.0 (#207)

Long Context benchmarks
BenchmarkGemini 1.0 ProGemini Advanced 0514
LMArena Longer Query11321253

Writing & Preference Gemini Advanced 0514 leads

Gemini 1.0 Pro: 36.0 (#264), Gemini Advanced 0514: 48.5 (#200)

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProGemini Advanced 0514
LMArena Text11491279
LMArena Creative Writing11311284
LMArena Multi-Turn11391269

Frequently asked questions

Is Gemini 1.0 Pro better than Gemini Advanced 0514?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or Gemini Advanced 0514 better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Gemini Advanced 0514 share?

16 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Gemini Advanced 0514 has 17.

Related comparisons

Go deeper