Model comparison

Gemini 2.0 Flash-Lite vs GPT-4 Turbo

Gemini 2.0 Flash-Lite is the stronger model overall, scoring 37.3 to 30.3 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemini 2.0 Flash-Lite Google

37.3

Rank #189 Confirmed

GPT-4 Turbo OpenAI

30.3

Rank #281 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 2.0 Flash-Lite scores higher in 9 categories and GPT-4 Turbo in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.0 Flash-Lite leads 31.8 to 8.6.
  • The biggest single-benchmark swing is DTBench: 52.5% for Gemini 2.0 Flash-Lite and 61.6% for GPT-4 Turbo.

Side by side

Gemini 2.0 Flash-Lite and GPT-4 Turbo specifications
Gemini 2.0 Flash-LiteGPT-4 Turbo
ProviderGoogleOpenAI
Noometry Index37.330.3
Released2025-02-052023-11-06
WeightsProprietaryProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$10
Output $ / M tokens—$30
Results tracked3236

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 37.4 (#181), GPT-4 Turbo: 33.4 (#247)

Coding benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
LMArena Coding13221268
WeirdML—18%
BigCodeBench Instruct—48.2%
LiveBench Coding47.1%—
BigCodeBench Complete—58.2%
HumanEval+—86.6%
MBPP+—73.3%

Agentic & Tool Use Not comparable

Gemini 2.0 Flash-Lite: —, GPT-4 Turbo: —

Agentic & Tool Use benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
METR Time Horizons—36.7%

Reasoning Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 21.2 (#203), GPT-4 Turbo: 14.9 (#311)

Reasoning benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
LMArena Hard Prompts13241251
DTBench52.5%61.6%
ForecastBench57.159.4
SimpleBench—25.1%
Chess Puzzles—6%
LiveBench Reasoning50.1%—
LiveBench Data Analysis65.5%—
LMCA—9.8%
Epoch Capabilities Index—127.25
LiveBench54.3%—

Math Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 31.8 (#192), GPT-4 Turbo: 8.6 (#316)

Math benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
LMArena Math13091272
FrontierMath (Tiers 1-3)—0.7%
OTIS Mock AIME 2024-2025—6.7%
Omni-MATH37.4%—
LiveBench Math58.1%—
MATH Level 5—46.7%

Knowledge Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 34.6 (#185), GPT-4 Turbo: 24.3 (#263)

Knowledge benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
LMArena Expert13051223
GPQA Diamond—46.6%
MMLU-Pro72%—
Confabulations—28.4%
GPQA (HELM)50%—
MMLU—81.3%

Multimodal Too close to call

Gemini 2.0 Flash-Lite: 30.6 (#103), GPT-4 Turbo: 30.0 (#104)

Multimodal benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
LMArena Vision11001090

Multilingual Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 46.2 (#156), GPT-4 Turbo: 40.7 (#211)

Multilingual benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
LMArena Non-English13231245
LMArena Chinese13391242
LMArena French13461275
LMArena German13061259
LMArena Japanese13021194
LMArena Korean13251187
LMArena Russian13281259
LMArena Spanish13131260

Instruction Following Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 70.6 (#158), GPT-4 Turbo: 66.0 (#211)

Instruction Following benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
LMArena Instruction Following13051250
LiveBench Instruction Following78.3%—
IFEval82.4%—

Long Context Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 40.1 (#155), GPT-4 Turbo: 38.0 (#200)

Long Context benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
LMArena Longer Query13211254

Writing & Preference Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 51.9 (#172), GPT-4 Turbo: 47.9 (#201)

Writing & Preference benchmarks
BenchmarkGemini 2.0 Flash-LiteGPT-4 Turbo
LMArena Text13301272
LMArena Creative Writing13191269
LMArena Multi-Turn13071267
WildBench79%—
LiveBench Language34.3%—

Frequently asked questions

Is Gemini 2.0 Flash-Lite better than GPT-4 Turbo?

Gemini 2.0 Flash-Lite is the stronger model overall, scoring 37.3 to 30.3 on the Noometry Index.

Is Gemini 2.0 Flash-Lite or GPT-4 Turbo better for coding?

Gemini 2.0 Flash-Lite scores higher on coding benchmarks: 37.4 versus 33.4 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Flash-Lite and GPT-4 Turbo share?

20 benchmarks have published results for both models. Gemini 2.0 Flash-Lite has 32 scored results on Noometry and GPT-4 Turbo has 36.

Related comparisons

Go deeper