Noometry

Model comparison

Gemini 3.1 Pro Preview vs GPT-6 Astra

GPT-6 Astra is the stronger model overall, scoring 70.8 to 56.7 on the Noometry Index. Gemini 3.1 Pro Preview costs 4.4× less per token, which makes it the better buy when GPT-6 Astra's lead doesn't matter for your workload.

Last verified . 51 shared benchmarks.

Gemini 3.1 Pro Preview Google

56.7

Rank #23 Confirmed

GPT-6 Astra OpenAI

70.8

Rank #1 Confirmed

Summary

  • They share 51 benchmarks with published results for both. Gemini 3.1 Pro Preview scores higher in 3 categories and GPT-6 Astra in 7 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-6 Astra leads 93.5 to 62.1.
  • The biggest single-benchmark swing is ProofBench: 26% for Gemini 3.1 Pro Preview and 99% for GPT-6 Astra.
  • Gemini 3.1 Pro Preview is cheaper at $2 / $12 per million input/output tokens, against $10 / $50 for GPT-6 Astra.
  • GPT-6 Astra accepts more context: 1.05M tokens versus 1.05M.

Side by side

Gemini 3.1 Pro PreviewGPT-6 Astra
ProviderGoogleOpenAI
Noometry Index56.770.8
Released2026-02-192026-09-03
WeightsProprietaryProprietary
Context window1.05M1.05M
Max output66K128K
Input $ / M tokens$2$10
Output $ / M tokens$12$50
Results tracked7156

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6 Astra leads

Gemini 3.1 Pro Preview: 42.5 (#99), GPT-6 Astra: 73.7 (#2)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
DeepSWE11.7%74.1%
LMArena WebDev14471786
SciCode58.9%56.5%
GSO22.6%79.4%
WeirdML72.1%93.6%
LMArena Coding14841487
MirrorCode8.9%46.7%
ALE-Bench1,1612,951
SWE-bench Verified75.6%—
FrontierCode—53.3%
FrontierSWE—65.5%
AlgoTune2.02—

Agentic & Tool Use GPT-6 Astra leads

Gemini 3.1 Pro Preview: 37.7 (#34), GPT-6 Astra: 52.9 (#3)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
APEX-Agents35.3%64.7%
BALROG57%68.3%
GDP.pdf17%34.2%
Vending-Bench 23,77415,515
Terminal-Bench80.2%—
Remote Labor Index—20.8%
τ²-bench Banking26%—
DeepResearch Bench47.8%—
PostTrainBench22%—
ExploitBench26.1%—
GBAEval0.8%—
LMArena Search1211—
METR Time Horizons77%—

Reasoning GPT-6 Astra leads

Gemini 3.1 Pro Preview: 71.7 (#12), GPT-6 Astra: 85.1 (#1)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
ARC-AGI-277.1%95%
NYT Connections (extended)97.4%98.1%
ARC-AGI-198%98.5%
CritPt17.7%31.7%
Chess Puzzles55%72%
EBR-Bench14.3%76.2%
LMArena Hard Prompts14851462
Mystery Game Puzzles34%84%
DTBench97.1%97.3%
LMCA53.8%64.4%
Epoch Capabilities Index154.77166.45
SimpleBench79.6%—
EnigmaEval36.8%—
Thematic Generalization79.4%—
Bench to the Future 3—0.14
ForecastBench59—

Math GPT-6 Astra leads

Gemini 3.1 Pro Preview: 62.1 (#34), GPT-6 Astra: 93.5 (#2)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
FrontierMath (Tiers 1-3)59.6%93.7%
FrontierMath Tier 426.8%97.6%
OTIS Mock AIME 2024-202595.6%100%
ProofBench26%99%
LMArena Math14851465
MathArena Final-Answer Competitions86.5%—
FrontierMath (Feb 2025 set)36.9%—
FrontierMath Erdős—2.9%
FrontierMath Tier 4 (v1)16.7%—

Knowledge GPT-6 Astra leads

Gemini 3.1 Pro Preview: 71.8 (#3), GPT-6 Astra: 75.3 (#1)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
GPQA Diamond94.4%95.8%
Humanity's Last Exam46.4%54.8%
SimpleQA Verified73.5%75.6%
Vectara Hallucination Rate10.4%8.7%
LMArena Expert14851483

Multimodal GPT-6 Astra leads

Gemini 3.1 Pro Preview: 37.9 (#69), GPT-6 Astra: 55.0 (#3)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
LMArena Vision12961281
Blueprint-Bench 226.5%49.7%
Furniture Assembly26.7%80%
LMArena Document14441468

Multilingual Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 57.0 (#12), GPT-6 Astra: 53.7 (#61)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
LMArena Non-English14771430
LMArena Chinese15291484
LMArena French14871456
LMArena German14911440
LMArena Japanese14931379
LMArena Korean14551426
LMArena Russian14981436
LMArena Spanish14791407

Instruction Following Too close to call

Gemini 3.1 Pro Preview: 77.0 (#32), GPT-6 Astra: 76.3 (#44)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
LMArena Instruction Following14661450

Long Context Gemini 3.1 Pro Preview leads

Gemini 3.1 Pro Preview: 47.4 (#18), GPT-6 Astra: 44.5 (#62)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
LMArena Longer Query14831456
CL-bench20.8%—
CL-bench Life16.9%—

Writing & Preference GPT-6 Astra leads

Gemini 3.1 Pro Preview: 66.1 (#37), GPT-6 Astra: 75.3 (#7)

BenchmarkGemini 3.1 Pro PreviewGPT-6 Astra
LMArena Text14811441
LMArena Creative Writing14821418
EQ-Bench Creative Writing14912173
LMArena Multi-Turn14881448
EQ-Bench 41142—

Frequently asked questions

Is Gemini 3.1 Pro Preview better than GPT-6 Astra?

GPT-6 Astra is the stronger model overall, scoring 70.8 to 56.7 on the Noometry Index. Gemini 3.1 Pro Preview costs 4.4× less per token, which makes it the better buy when GPT-6 Astra's lead doesn't matter for your workload.

Which is cheaper, Gemini 3.1 Pro Preview or GPT-6 Astra?

Gemini 3.1 Pro Preview is cheaper. It lists at $2 per million input tokens and $12 per million output tokens; GPT-6 Astra lists at $10 and $50.

Is Gemini 3.1 Pro Preview or GPT-6 Astra better for coding?

GPT-6 Astra scores higher on coding benchmarks: 73.7 versus 42.5 in the Noometry coding category.

Which has the bigger context window?

GPT-6 Astra does, with 1.05M tokens against 1.05M.

How many benchmarks do Gemini 3.1 Pro Preview and GPT-6 Astra share?

51 benchmarks have published results for both models. Gemini 3.1 Pro Preview has 71 scored results on Noometry and GPT-6 Astra has 56.

Related comparisons

Go deeper