Noometry

Model comparison

Gemini 2.5 Flash-Lite vs o3

o3 is the stronger model overall, scoring 47.5 to 37.0 on the Noometry Index. Gemini 2.5 Flash-Lite costs 20× less per token, which makes it the better buy when o3's lead doesn't matter for your workload.

Last verified . 32 shared benchmarks.

Gemini 2.5 Flash-Lite Google

37.0

Rank #211 Confirmed

o3 OpenAI

47.5

Rank #61 Confirmed

Summary

  • They share 32 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 0 categories and o3 in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where o3 leads 54.6 to 32.5.
  • The biggest single-benchmark swing is GPQA (HELM): 30.9% for Gemini 2.5 Flash-Lite and 75.3% for o3.
  • Gemini 2.5 Flash-Lite is cheaper at $0.10 / $0.40 per million input/output tokens, against $2 / $8 for o3.
  • Gemini 2.5 Flash-Lite accepts more context: 1.05M tokens versus 200K.

Side by side

Gemini 2.5 Flash-Liteo3
ProviderGoogleOpenAI
Noometry Index37.047.5
Released2025-06-172025-04-16
WeightsProprietaryProprietary
Context window1.05M200K
Max output66K100K
Input $ / M tokens$0.10$2
Output $ / M tokens$0.40$8
Results tracked3363

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3 leads

Gemini 2.5 Flash-Lite: 38.5 (#173), o3: 46.8 (#64)

BenchmarkGemini 2.5 Flash-Liteo3
WeirdML35.2%52.4%
LMArena Coding13731408
ALE-Bench325.9933.55
SWE-bench Verified—62.3%
SWE-bench Verified (bash only)—58.4%
Aider Polyglot—81.3%
GSO—8.8%
CadEval—74%

Agentic & Tool Use o3 leads

Gemini 2.5 Flash-Lite: 28.0 (#96), o3: 34.5 (#44)

BenchmarkGemini 2.5 Flash-Liteo3
Berkeley Function Calling Leaderboard36.9%63%
GDPval—30.8%
DeepResearch Bench—45.2%
OSWorld—23%
LMArena Search—1144
METR Time Horizons—65.4%

Reasoning o3 leads

Gemini 2.5 Flash-Lite: 22.2 (#205), o3: 32.0 (#78)

BenchmarkGemini 2.5 Flash-Liteo3
Kagi LLM Benchmark40.5%67.6%
LMArena Hard Prompts13771402
DTBench62.8%84.8%
LMCA18.1%39.7%
Epoch Capabilities Index133.94146.86
ARC-AGI-2—6.5%
SimpleBench—53.1%
ARC-AGI-1—60.8%
CritPt—1.4%
Chess Puzzles—38%
EnigmaEval—13.1%
Mystery Game Puzzles—29%
ForecastBench—62.5

Math o3 leads

Gemini 2.5 Flash-Lite: 38.0 (#144), o3: 50.2 (#58)

BenchmarkGemini 2.5 Flash-Liteo3
Omni-MATH48%71.4%
LMArena Math13731426
FrontierMath (Tiers 1-3)—33.3%
OTIS Mock AIME 2024-2025—84.4%
MATH Level 5—97.8%
FrontierMath (Feb 2025 set)—18.7%
FrontierMath Tier 4 (v1)—2.1%

Knowledge o3 leads

Gemini 2.5 Flash-Lite: 32.5 (#210), o3: 54.6 (#52)

BenchmarkGemini 2.5 Flash-Liteo3
MMLU-Pro53.7%85.9%
GPQA (HELM)30.9%75.3%
LMArena Expert13731402
GPQA Diamond—81.8%
Humanity's Last Exam—20.3%
SimpleQA Verified—49.4%
Confabulations—14.4%
Vectara Hallucination Rate3.3%—

Multimodal o3 leads

Gemini 2.5 Flash-Lite: 29.1 (#114), o3: 41.4 (#36)

BenchmarkGemini 2.5 Flash-Liteo3
LMArena Vision11981214
VPCT30%52%
GeoBench—74%

Multilingual o3 leads

Gemini 2.5 Flash-Lite: 49.3 (#134), o3: 51.7 (#105)

BenchmarkGemini 2.5 Flash-Liteo3
LMArena Non-English13691401
LMArena Chinese14041437
LMArena French13881430
LMArena German13891420
LMArena Japanese13591403
LMArena Korean13601370
LMArena Russian13731406
LMArena Spanish13961395

Instruction Following o3 leads

Gemini 2.5 Flash-Lite: 70.0 (#168), o3: 72.8 (#127)

BenchmarkGemini 2.5 Flash-Liteo3
IFEval81%86.9%
LMArena Instruction Following13671368

Long Context o3 leads

Gemini 2.5 Flash-Lite: 33.3 (#262), o3: 53.3 (#6)

BenchmarkGemini 2.5 Flash-Liteo3
Fiction.LiveBench47.2%88.9%
LMArena Longer Query13731372
CL-bench—17.8%

Writing & Preference o3 leads

Gemini 2.5 Flash-Lite: 56.8 (#135), o3: 63.5 (#64)

BenchmarkGemini 2.5 Flash-Liteo3
LMArena Text13791410
LMArena Creative Writing13671359
WildBench81.8%86.1%
LMArena Multi-Turn13661405
Short-Story Creative Writing—83.9%
EQ-Bench Creative Writing—1676

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than o3?

o3 is the stronger model overall, scoring 47.5 to 37.0 on the Noometry Index. Gemini 2.5 Flash-Lite costs 20× less per token, which makes it the better buy when o3's lead doesn't matter for your workload.

Which is cheaper, Gemini 2.5 Flash-Lite or o3?

Gemini 2.5 Flash-Lite is cheaper. It lists at $0.10 per million input tokens and $0.40 per million output tokens; o3 lists at $2 and $8.

Is Gemini 2.5 Flash-Lite or o3 better for coding?

o3 scores higher on coding benchmarks: 46.8 versus 38.5 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash-Lite does, with 1.05M tokens against 200K.

How many benchmarks do Gemini 2.5 Flash-Lite and o3 share?

32 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and o3 has 63.

Related comparisons

Go deeper