Noometry

Model comparison

Gemini 1.0 Pro vs GPT-6.1 Sol

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 27.3 on the Noometry Index.

Last verified . 15 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

GPT-6.1 Sol OpenAI

65.6

Rank #6 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and GPT-6.1 Sol in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-6.1 Sol leads 93.7 to 9.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemini 1.0 Pro and 100% for GPT-6.1 Sol.

Side by side

Gemini 1.0 ProGPT-6.1 Sol
ProviderGoogleOpenAI
Noometry Index27.365.6
Released2023-12-132026-09-29
WeightsProprietaryProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$10
Results tracked2434

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6.1 Sol leads

Gemini 1.0 Pro: 32.2 (#275), GPT-6.1 Sol: 63.2 (#8)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
LMArena Coding11081487
DeepSWE—75.2%
FrontierCode—50.2%
LMArena WebDev—1755
SciCode—55.8%
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, GPT-6.1 Sol: 39.6 (#26)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
APEX-Agents—60%
GDP.pdf—32%

Reasoning GPT-6.1 Sol leads

Gemini 1.0 Pro: 17.1 (#296), GPT-6.1 Sol: 81.9 (#2)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
LMArena Hard Prompts11091466
Epoch Capabilities Index117.04166.09
ARC-AGI-2—94.2%
NYT Connections (extended)—95.5%
ARC-AGI-1—98.5%
CritPt—31.7%
Chess Puzzles—61%
EBR-Bench—54.3%
Mystery Game Puzzles—80%
DTBench45.9%—

Math GPT-6.1 Sol leads

Gemini 1.0 Pro: 9.3 (#321), GPT-6.1 Sol: 93.7 (#1)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
OTIS Mock AIME 2024-20251.1%100%
LMArena Math11321464
FrontierMath (Tiers 1-3)—93.7%
FrontierMath Tier 4—100%
ProofBench—99%
MATH Level 511.2%—

Knowledge GPT-6.1 Sol leads

Gemini 1.0 Pro: 15.6 (#291), GPT-6.1 Sol: 71.8 (#4)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
GPQA Diamond34%95.4%
LMArena Expert10591502
SimpleQA Verified—73.9%
MMLU70%—

Multimodal Not comparable

Gemini 1.0 Pro: —, GPT-6.1 Sol: 52.7 (#5)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
LMArena Vision—1288
Furniture Assembly—80%

Multilingual GPT-6.1 Sol leads

Gemini 1.0 Pro: 33.4 (#252), GPT-6.1 Sol: 54.3 (#46)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
LMArena Non-English11381438
LMArena Chinese11241477
LMArena Russian11861455
LMArena French1145—
LMArena German1125—
LMArena Japanese1023—
LMArena Spanish1119—

Instruction Following GPT-6.1 Sol leads

Gemini 1.0 Pro: 57.6 (#267), GPT-6.1 Sol: 77.0 (#29)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
LMArena Instruction Following11141468

Long Context GPT-6.1 Sol leads

Gemini 1.0 Pro: 34.3 (#249), GPT-6.1 Sol: 44.9 (#54)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
LMArena Longer Query11321465

Writing & Preference GPT-6.1 Sol leads

Gemini 1.0 Pro: 36.0 (#264), GPT-6.1 Sol: 63.6 (#63)

BenchmarkGemini 1.0 ProGPT-6.1 Sol
LMArena Text11491447
LMArena Creative Writing11311432
LMArena Multi-Turn11391449

Frequently asked questions

Is Gemini 1.0 Pro better than GPT-6.1 Sol?

GPT-6.1 Sol is the stronger model overall, scoring 65.6 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or GPT-6.1 Sol better for coding?

GPT-6.1 Sol scores higher on coding benchmarks: 63.2 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and GPT-6.1 Sol share?

15 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and GPT-6.1 Sol has 34.

Related comparisons

Go deeper