Model comparison

Gemini 2.5 Flash-Lite vs Gemma 3 4B

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 28.1 on the Noometry Index. Gemma 3 4B costs 3.5× less per token, which makes it the better buy when Gemini 2.5 Flash-Lite's lead doesn't matter for your workload.

Last verified October 10, 2026. 18 shared benchmarks.

Gemini 2.5 Flash-Lite

Google

37.0

Rank #211 Confirmed

Gemma 3 4B

Google

28.1

Rank #326 Confirmed

Summary

They share 18 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 8 categories and Gemma 3 4B in 1 category; 9 gaps are clear of the uncertainty.
The widest gap is in math, where Gemini 2.5 Flash-Lite leads 38.0 to 16.8.
The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 36.9% for Gemini 2.5 Flash-Lite and 19.6% for Gemma 3 4B.
Gemma 3 4B is cheaper at $0.04 / $0.08 per million input/output tokens, against $0.10 / $0.40 for Gemini 2.5 Flash-Lite.
Gemini 2.5 Flash-Lite accepts more context: 1.05M tokens versus 131K.
Gemma 3 4B has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash-Lite and Gemma 3 4B specifications
	Gemini 2.5 Flash-Lite	Gemma 3 4B
Provider	Google	Google
Noometry Index	37.0	28.1
Released	2025-06-17	2025-03-12
Weights	Proprietary	Open
Context window	1.05M	131K
Max output	66K	4K
Input $ / M tokens	$0.10	$0.04
Output $ / M tokens	$0.40	$0.08
Results tracked	33	22

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.5 (#173), Gemma 3 4B: 35.9 (#215)

Coding benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
LMArena Coding	1373	1230
WeirdML	35.2%	—
ALE-Bench	325.9	—

Agentic & Tool Use Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 28.0 (#96), Gemma 3 4B: 20.9 (#142)

Agentic & Tool Use benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
Berkeley Function Calling Leaderboard	36.9%	19.6%

Reasoning Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 22.2 (#205), Gemma 3 4B: 13.2 (#335)

Reasoning benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
Kagi LLM Benchmark	40.5%	25.2%
LMArena Hard Prompts	1377	1253
DTBench	62.8%	50.9%
LMCA	18.1%	2.8%
Epoch Capabilities Index	133.94	116.02
Chess Puzzles	—	0%

Math Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.0 (#144), Gemma 3 4B: 16.8 (#292)

Math benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
LMArena Math	1373	1239
OTIS Mock AIME 2024-2025	—	7.5%
Omni-MATH	48%	—

Knowledge Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 32.5 (#210), Gemma 3 4B: 11.8 (#299)

Knowledge benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
Vectara Hallucination Rate	3.3%	6.4%
LMArena Expert	1373	1223
GPQA Diamond	—	23.2%
MMLU-Pro	53.7%	—
GPQA (HELM)	30.9%	—

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 29.1 (#114), Gemma 3 4B: —

Multimodal benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
LMArena Vision	1198	—
VPCT	30%	—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.3 (#134), Gemma 3 4B: 42.5 (#194)

Multilingual benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
LMArena Non-English	1369	1273
LMArena German	1389	1281
LMArena Russian	1373	1294
LMArena Chinese	1404	—
LMArena French	1388	—
LMArena Japanese	1359	—
LMArena Korean	1360	—
LMArena Spanish	1396	—

Instruction Following Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 70.0 (#168), Gemma 3 4B: 65.2 (#225)

Instruction Following benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
LMArena Instruction Following	1367	1239
IFEval	81%	—

Long Context Gemma 3 4B leads

Gemini 2.5 Flash-Lite: 33.3 (#262), Gemma 3 4B: 38.7 (#194)

Long Context benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
LMArena Longer Query	1373	1273
Fiction.LiveBench	47.2%	—

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 56.8 (#135), Gemma 3 4B: 42.0 (#239)

Writing & Preference benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Gemma 3 4B
LMArena Text	1379	1291
LMArena Creative Writing	1367	1271
LMArena Multi-Turn	1366	1255
EQ-Bench Creative Writing	—	1068
WildBench	81.8%	—

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Gemma 3 4B?

Which is cheaper, Gemini 2.5 Flash-Lite or Gemma 3 4B?

Gemma 3 4B is cheaper. It lists at $0.04 per million input tokens and $0.08 per million output tokens; Gemini 2.5 Flash-Lite lists at $0.10 and $0.40.

Is Gemini 2.5 Flash-Lite or Gemma 3 4B better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.5 versus 35.9 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash-Lite does, with 1.05M tokens against 131K.

How many benchmarks do Gemini 2.5 Flash-Lite and Gemma 3 4B share?

18 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Gemma 3 4B has 22.