Noometry

Model comparison

Gemini 3.5 Flash Lite vs GPT-4o

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.8 to 28.5 on the Noometry Index.

Last verified . 29 shared benchmarks.

Gemini 3.5 Flash Lite Google

41.8

Rank #113 Confirmed

GPT-4o OpenAI

28.5

Rank #316 Confirmed

Summary

  • They share 29 benchmarks with published results for both. Gemini 3.5 Flash Lite scores higher in 10 categories and GPT-4o in 0 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.5 Flash Lite leads 50.0 to 28.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 71.1% for Gemini 3.5 Flash Lite and 6.4% for GPT-4o.
  • Gemini 3.5 Flash Lite is cheaper at $0.30 / $2.50 per million input/output tokens, against $2.50 / $10 for GPT-4o.
  • Gemini 3.5 Flash Lite accepts more context: 1.05M tokens versus 128K.

Side by side

Gemini 3.5 Flash LiteGPT-4o
ProviderGoogleOpenAI
Noometry Index41.828.5
Released2026-07-212024-05-13
WeightsProprietaryProprietary
Context window1.05M128K
Max output66K16K
Input $ / M tokens$0.30$2.50
Output $ / M tokens$2.50$10
Results tracked3872

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 42.1 (#96), GPT-4o: 25.1 (#323)

BenchmarkGemini 3.5 Flash LiteGPT-4o
WeirdML39%25.1%
LMArena Coding14551297
SWE-bench Verified—31%
SWE-bench Verified (bash only)—21.6%
Aider Polyglot—45.3%
LMArena WebDev1440—
SciCode41.3%—
GSO—0%
BigCodeBench Instruct—51.1%
LiveBench Coding—51.4%
BigCodeBench Complete—61.1%
CadEval—26%
ALE-Bench765.27—
HumanEval+—87.2%
MBPP+—72.2%

Agentic & Tool Use Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 28.6 (#82), GPT-4o: 20.8 (#133)

BenchmarkGemini 3.5 Flash LiteGPT-4o
GDPval—9.9%
TheAgentCompany—8.6%
Cybench—12.5%
BALROG—32.3%
GDP.pdf10%—
LMArena Search—1006
METR Time Horizons—40.8%

Reasoning Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 27.8 (#95), GPT-4o: 9.4 (#338)

BenchmarkGemini 3.5 Flash LiteGPT-4o
ARC-AGI-210.3%0%
ARC-AGI-153.5%4.5%
CritPt0%0%
Chess Puzzles22%13%
LMArena Hard Prompts14411281
DTBench83.5%64.5%
LMCA37.6%16.6%
Epoch Capabilities Index145.12128.97
SimpleBench—17.8%
NYT Connections (extended)60.4%—
EnigmaEval—0.8%
LiveBench Reasoning—55.8%
Mystery Game Puzzles19%—
LiveBench Data Analysis—60.9%
ForecastBench—57.7
LiveBench—55.3%

Math Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 25.7 (#245), GPT-4o: 10.2 (#303)

BenchmarkGemini 3.5 Flash LiteGPT-4o
FrontierMath (Tiers 1-3)26%0.4%
OTIS Mock AIME 2024-202571.1%6.4%
LMArena Math14311285
FrontierMath Tier 40%—
ProofBench13%—
Omni-MATH—29.3%
LiveBench Math—49.5%
MATH Level 5—53.3%
FrontierMath (Feb 2025 set)—0.3%

Knowledge Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 50.0 (#66), GPT-4o: 28.8 (#235)

BenchmarkGemini 3.5 Flash LiteGPT-4o
GPQA Diamond83.3%49.2%
LMArena Expert14301250
Humanity's Last Exam—2.7%
SimpleQA Verified—26%
MMLU-Pro—71.3%
Confabulations—15.3%
Vectara Hallucination Rate—9.6%
GPQA (HELM)—52%
MMLU—88.1%

Multimodal Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 40.3 (#38), GPT-4o: 33.9 (#85)

BenchmarkGemini 3.5 Flash LiteGPT-4o
LMArena Vision12661137
Video-MME—71.9%
GeoBench—71%
VPCT—40%
ScienceQA—88.5%

Multilingual Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 53.8 (#59), GPT-4o: 43.4 (#181)

BenchmarkGemini 3.5 Flash LiteGPT-4o
LMArena Non-English14281283
LMArena Chinese14671277
LMArena French14521303
LMArena German14541282
LMArena Japanese14281257
LMArena Korean14061234
LMArena Russian14431286
LMArena Spanish14401292

Instruction Following Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 75.0 (#77), GPT-4o: 66.8 (#202)

BenchmarkGemini 3.5 Flash LiteGPT-4o
LMArena Instruction Following14201278
LiveBench Instruction Following—68.6%
IFEval—81.7%

Long Context Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 43.8 (#80), GPT-4o: 39.4 (#174)

BenchmarkGemini 3.5 Flash LiteGPT-4o
LMArena Longer Query14351289
Fiction.LiveBench—66.7%

Writing & Preference Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 64.4 (#55), GPT-4o: 52.8 (#160)

BenchmarkGemini 3.5 Flash LiteGPT-4o
LMArena Text14361300
LMArena Creative Writing14191291
LMArena Multi-Turn14451302
Short-Story Creative Writing—81.8%
EQ-Bench Creative Writing1559—
WildBench—82.8%
LiveBench Language—47.6%

Frequently asked questions

Is Gemini 3.5 Flash Lite better than GPT-4o?

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.8 to 28.5 on the Noometry Index.

Which is cheaper, Gemini 3.5 Flash Lite or GPT-4o?

Gemini 3.5 Flash Lite is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; GPT-4o lists at $2.50 and $10.

Is Gemini 3.5 Flash Lite or GPT-4o better for coding?

Gemini 3.5 Flash Lite scores higher on coding benchmarks: 42.1 versus 25.1 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.5 Flash Lite does, with 1.05M tokens against 128K.

How many benchmarks do Gemini 3.5 Flash Lite and GPT-4o share?

29 benchmarks have published results for both models. Gemini 3.5 Flash Lite has 38 scored results on Noometry and GPT-4o has 72.

Related comparisons

Go deeper