Noometry

Model comparison

Gemini 3 Flash Preview vs o3-mini

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 36.7 on the Noometry Index.

Last verified . 35 shared benchmarks.

Gemini 3 Flash Preview Google

52.3

Rank #40 Confirmed

o3-mini OpenAI

36.7

Rank #212 Confirmed

Summary

  • They share 35 benchmarks with published results for both. Gemini 3 Flash Preview scores higher in 9 categories and o3-mini in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Flash Preview leads 49.2 to 16.3.
  • The biggest single-benchmark swing is SimpleQA Verified: 66.8% for Gemini 3 Flash Preview and 15.3% for o3-mini.
  • Gemini 3 Flash Preview is cheaper at $0.50 / $3 per million input/output tokens, against $1.10 / $4.40 for o3-mini.
  • Gemini 3 Flash Preview accepts more context: 1.05M tokens versus 200K.

Side by side

Gemini 3 Flash Previewo3-mini
ProviderGoogleOpenAI
Noometry Index52.336.7
Released2025-12-172024-12-20
WeightsProprietaryProprietary
Context window1.05M200K
Max output66K100K
Input $ / M tokens$0.50$1.10
Output $ / M tokens$3$4.40
Results tracked5951

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 50.9 (#42), o3-mini: 40.8 (#132)

BenchmarkGemini 3 Flash Previewo3-mini
GSO9.8%1.3%
WeirdML61.6%43.7%
LMArena Coding14601378
SWE-bench Verified75.4%—
SWE-bench Verified (bash only)75.8%—
Aider Polyglot—60.4%
LMArena WebDev1439—
SWE-bench Multilingual72.7%—
SciCode—39.8%
LiveBench Coding—82.7%
CadEval—54%
ALE-Bench1,367—

Agentic & Tool Use Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 38.7 (#29), o3-mini: 29.6 (#84)

BenchmarkGemini 3 Flash Previewo3-mini
Terminal-Bench64.3%—
τ²-bench Airline82.5%—
τ²-bench Banking27.3%—
τ²-bench Retail76.8%—
τ²-bench Telecom91.2%—
Cybench—22.5%
DeepResearch Bench49.8%—
BALROG48.1%—
GDP.pdf10%—
LMArena Search1198—
Vending-Bench 23,635—

Reasoning Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 49.2 (#37), o3-mini: 16.3 (#305)

BenchmarkGemini 3 Flash Previewo3-mini
ARC-AGI-233.6%3%
SimpleBench61.1%22.8%
ARC-AGI-184.7%34.5%
Chess Puzzles40%17%
LMArena Hard Prompts14651366
Mystery Game Puzzles26%7%
DTBench89.1%68.8%
LMCA43.1%19%
Epoch Capabilities Index151.8140.34
ForecastBench58.559.6
NYT Connections (extended)83.1%—
CritPt—0.3%
LiveBench Reasoning—89.6%
LiveBench Data Analysis—70.6%
LiveBench—75.9%

Math Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 51.7 (#55), o3-mini: 28.1 (#244)

BenchmarkGemini 3 Flash Previewo3-mini
FrontierMath (Tiers 1-3)51.2%18.6%
FrontierMath Tier 417.1%0%
OTIS Mock AIME 2024-202595.6%76.9%
LMArena Math14731396
FrontierMath (Feb 2025 set)35.6%12.4%
FrontierMath Tier 4 (v1)4.2%4.2%
MathArena Final-Answer Competitions67.6%—
ProofBench15%—
LiveBench Math—77.3%
MATH Level 5—96.5%

Knowledge Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 58.8 (#33), o3-mini: 38.3 (#146)

BenchmarkGemini 3 Flash Previewo3-mini
GPQA Diamond89.4%77%
SimpleQA Verified66.8%15.3%
LMArena Expert14621364
Confabulations—17.9%
Vectara Hallucination Rate13.5%—

Multimodal Not comparable

Gemini 3 Flash Preview: 45.5 (#16), o3-mini: —

BenchmarkGemini 3 Flash Previewo3-mini
LMArena Vision1285—
GeoBench88%—
VPCT72.6%—
Blueprint-Bench 20%—
LMArena Document1413—

Multilingual Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 55.7 (#27), o3-mini: 45.7 (#164)

BenchmarkGemini 3 Flash Previewo3-mini
LMArena Non-English14581319
LMArena Chinese15111379
LMArena French14771334
LMArena German14971303
LMArena Japanese14891286
LMArena Korean14431314
LMArena Russian14801304
LMArena Spanish14691321

Instruction Following Too close to call

Gemini 3 Flash Preview: 75.7 (#56), o3-mini: 75.1 (#72)

BenchmarkGemini 3 Flash Previewo3-mini
LMArena Instruction Following14371337
LiveBench Instruction Following—84.4%

Long Context Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 44.4 (#67), o3-mini: 33.8 (#256)

BenchmarkGemini 3 Flash Previewo3-mini
LMArena Longer Query14521343
Fiction.LiveBench—50%

Writing & Preference Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 65.5 (#45), o3-mini: 50.3 (#182)

BenchmarkGemini 3 Flash Previewo3-mini
LMArena Text14661337
LMArena Creative Writing14571286
LMArena Multi-Turn14711320
Short-Story Creative Writing—61.7%
LiveBench Language—50.7%

Frequently asked questions

Is Gemini 3 Flash Preview better than o3-mini?

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 36.7 on the Noometry Index.

Which is cheaper, Gemini 3 Flash Preview or o3-mini?

Gemini 3 Flash Preview is cheaper. It lists at $0.50 per million input tokens and $3 per million output tokens; o3-mini lists at $1.10 and $4.40.

Is Gemini 3 Flash Preview or o3-mini better for coding?

Gemini 3 Flash Preview scores higher on coding benchmarks: 50.9 versus 40.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 3 Flash Preview does, with 1.05M tokens against 200K.

How many benchmarks do Gemini 3 Flash Preview and o3-mini share?

35 benchmarks have published results for both models. Gemini 3 Flash Preview has 59 scored results on Noometry and o3-mini has 51.

Related comparisons

Go deeper