Noometry

Model comparison

Gemini 3 Flash Preview vs GPT-5.1

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 49.0 on the Noometry Index.

Last verified . 45 shared benchmarks.

Gemini 3 Flash Preview Google

52.3

Rank #40 Confirmed

GPT-5.1 OpenAI

49.0

Rank #53 Confirmed

Summary

  • They share 45 benchmarks with published results for both. Gemini 3 Flash Preview scores higher in 7 categories and GPT-5.1 in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Flash Preview leads 49.2 to 39.8.
  • The biggest single-benchmark swing is SimpleQA Verified: 66.8% for Gemini 3 Flash Preview and 48% for GPT-5.1.
  • Gemini 3 Flash Preview is cheaper at $0.50 / $3 per million input/output tokens, against $1.25 / $10 for GPT-5.1.
  • Gemini 3 Flash Preview accepts more context: 1.05M tokens versus 400K.

Side by side

Gemini 3 Flash PreviewGPT-5.1
ProviderGoogleOpenAI
Noometry Index52.349.0
Released2025-12-172025-11-13
WeightsProprietaryProprietary
Context window1.05M400K
Max output66K128K
Input $ / M tokens$0.50$1.25
Output $ / M tokens$3$10
Results tracked5963

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 50.9 (#42), GPT-5.1: 46.4 (#66)

BenchmarkGemini 3 Flash PreviewGPT-5.1
SWE-bench Verified75.4%68%
SWE-bench Verified (bash only)75.8%66%
LMArena WebDev14391395
GSO9.8%13.7%
WeirdML61.6%60.8%
LMArena Coding14601454
ALE-Bench1,3671,192
SWE-bench Multilingual72.7%—
SciCode—43.3%
LiveBench Coding—72.5%

Agentic & Tool Use Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 38.7 (#29), GPT-5.1: 32.7 (#60)

BenchmarkGemini 3 Flash PreviewGPT-5.1
Terminal-Bench64.3%47.6%
DeepResearch Bench49.8%42.8%
LMArena Search11981199
Vending-Bench 23,6351,473
τ²-bench Airline82.5%—
τ²-bench Banking27.3%—
τ²-bench Retail76.8%—
τ²-bench Telecom91.2%—
BALROG48.1%—
GDP.pdf10%—

Reasoning Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 49.2 (#37), GPT-5.1: 39.8 (#58)

BenchmarkGemini 3 Flash PreviewGPT-5.1
ARC-AGI-233.6%17.6%
SimpleBench61.1%53.2%
ARC-AGI-184.7%72.8%
Chess Puzzles40%32%
LMArena Hard Prompts14651457
Mystery Game Puzzles26%19%
DTBench89.1%90.1%
LMCA43.1%43.9%
Epoch Capabilities Index151.8149.64
ForecastBench58.558.1
NYT Connections (extended)83.1%—
CritPt—4.9%
EnigmaEval—11.2%
LiveBench Reasoning—95.8%
LiveBench Data Analysis—72.1%
LiveBench—78.8%

Math Too close to call

Gemini 3 Flash Preview: 51.7 (#55), GPT-5.1: 52.2 (#51)

BenchmarkGemini 3 Flash PreviewGPT-5.1
OTIS Mock AIME 2024-202595.6%88.6%
LMArena Math14731447
FrontierMath (Feb 2025 set)35.6%31%
FrontierMath Tier 4 (v1)4.2%12.5%
FrontierMath (Tiers 1-3)51.2%—
FrontierMath Tier 417.1%—
MathArena Final-Answer Competitions67.6%—
ProofBench15%—
Omni-MATH—46.4%
LiveBench Math—94.5%

Knowledge Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 58.8 (#33), GPT-5.1: 50.6 (#71)

BenchmarkGemini 3 Flash PreviewGPT-5.1
GPQA Diamond89.4%87.6%
SimpleQA Verified66.8%48%
Vectara Hallucination Rate13.5%10.9%
LMArena Expert14621470
Humanity's Last Exam—23.7%
MMLU-Pro—57.9%
GPQA (HELM)—44.2%

Multimodal Too close to call

Gemini 3 Flash Preview: 45.5 (#16), GPT-5.1: 44.8 (#19)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Vision12851250
VPCT72.6%58.7%
LMArena Document14131403
GeoBench88%—
Blueprint-Bench 20%—

Multilingual Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 55.7 (#27), GPT-5.1: 53.8 (#56)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Non-English14581431
LMArena Chinese15111495
LMArena French14771450
LMArena German14971438
LMArena Japanese14891453
LMArena Korean14431401
LMArena Russian14801435
LMArena Spanish14691433

Instruction Following GPT-5.1 leads

Gemini 3 Flash Preview: 75.7 (#56), GPT-5.1: 83.9 (#1)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Instruction Following14371443
LiveBench Instruction Following—93.3%
IFEval—93.5%

Long Context GPT-5.1 leads

Gemini 3 Flash Preview: 44.4 (#67), GPT-5.1: 47.6 (#14)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Longer Query14521447
CL-bench—23.7%
CL-bench Life—17.3%

Writing & Preference Too close to call

Gemini 3 Flash Preview: 65.5 (#45), GPT-5.1: 64.5 (#55)

BenchmarkGemini 3 Flash PreviewGPT-5.1
LMArena Text14661443
LMArena Creative Writing14571427
LMArena Multi-Turn14711450
WildBench—86.3%
LiveBench Language—80.2%

Frequently asked questions

Is Gemini 3 Flash Preview better than GPT-5.1?

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 49.0 on the Noometry Index.

Which is cheaper, Gemini 3 Flash Preview or GPT-5.1?

Gemini 3 Flash Preview is cheaper. It lists at $0.50 per million input tokens and $3 per million output tokens; GPT-5.1 lists at $1.25 and $10.

Is Gemini 3 Flash Preview or GPT-5.1 better for coding?

Gemini 3 Flash Preview scores higher on coding benchmarks: 50.9 versus 46.4 in the Noometry coding category.

Which has the bigger context window?

Gemini 3 Flash Preview does, with 1.05M tokens against 400K.

How many benchmarks do Gemini 3 Flash Preview and GPT-5.1 share?

45 benchmarks have published results for both models. Gemini 3 Flash Preview has 59 scored results on Noometry and GPT-5.1 has 63.

Related comparisons

Go deeper