Model comparison

Gemini 3.1 Flash Lite vs Gemma 3 4B

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 28.1 on the Noometry Index. Gemma 3 4B costs 11× less per token, which makes it the better buy when Gemini 3.1 Flash Lite's lead doesn't matter for your workload.

Last verified October 10, 2026. 20 shared benchmarks.

Gemini 3.1 Flash Lite

Google

40.8

Rank #144 Confirmed

Gemma 3 4B

Google

28.1

Rank #326 Confirmed

Summary

They share 20 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 9 categories and Gemma 3 4B in 0 categories; 9 gaps are clear of the uncertainty.
The widest gap is in knowledge, where Gemini 3.1 Flash Lite leads 41.9 to 11.8.
The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 80% for Gemini 3.1 Flash Lite and 7.5% for Gemma 3 4B.
Gemma 3 4B is cheaper at $0.04 / $0.08 per million input/output tokens, against $0.25 / $1.50 for Gemini 3.1 Flash Lite.
Gemini 3.1 Flash Lite accepts more context: 1.05M tokens versus 131K.
Gemma 3 4B has downloadable open weights; the other is API-only.

Side by side

Gemini 3.1 Flash Lite and Gemma 3 4B specifications
	Gemini 3.1 Flash Lite	Gemma 3 4B
Provider	Google	Google
Noometry Index	40.8	28.1
Released	2026-03-03	2025-03-12
Weights	Proprietary	Open
Context window	1.05M	131K
Max output	66K	4K
Input $ / M tokens	$0.25	$0.04
Output $ / M tokens	$1.50	$0.08
Results tracked	38	22

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 37.8 (#188), Gemma 3 4B: 35.9 (#215)

Coding benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
LMArena Coding	1400	1230
LMArena WebDev	1256	—
SciCode	41.9%	—
WeirdML	52.2%	—
ALE-Bench	797.73	—

Agentic & Tool Use Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 30.2 (#79), Gemma 3 4B: 20.9 (#142)

Agentic & Tool Use benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
Berkeley Function Calling Leaderboard	—	19.6%
DeepResearch Bench	37.3%	—

Reasoning Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 22.9 (#186), Gemma 3 4B: 13.2 (#335)

Reasoning benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
Kagi LLM Benchmark	67.2%	25.2%
Chess Puzzles	25%	0%
LMArena Hard Prompts	1407	1253
DTBench	76.8%	50.9%
LMCA	35%	2.8%
Epoch Capabilities Index	144.47	116.02
NYT Connections (extended)	8.2%	—
CritPt	1.1%	—
EnigmaEval	3%	—
Thematic Generalization	63.3%	—
ForecastBench	54.4	—

Math Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 40.7 (#90), Gemma 3 4B: 16.8 (#292)

Math benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
OTIS Mock AIME 2024-2025	80%	7.5%
LMArena Math	1428	1239
FrontierMath (Tiers 1-3)	27.7%	—

Knowledge Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 41.9 (#104), Gemma 3 4B: 11.8 (#299)

Knowledge benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
GPQA Diamond	81.8%	23.2%
Vectara Hallucination Rate	8.2%	6.4%
LMArena Expert	1398	1223
Humanity's Last Exam	8.6%	—

Multimodal Not comparable

Gemini 3.1 Flash Lite: 39.4 (#60), Gemma 3 4B: —

Multimodal benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
LMArena Vision	1240	—

Multilingual Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 52.3 (#86), Gemma 3 4B: 42.5 (#194)

Multilingual benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
LMArena Non-English	1411	1273
LMArena German	1429	1281
LMArena Russian	1420	1294
LMArena Chinese	1461	—
LMArena French	1424	—
LMArena Japanese	1413	—
LMArena Korean	1392	—
LMArena Spanish	1421	—

Instruction Following Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 72.7 (#131), Gemma 3 4B: 65.2 (#225)

Instruction Following benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
LMArena Instruction Following	1377	1239

Long Context Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 42.5 (#122), Gemma 3 4B: 38.7 (#194)

Long Context benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
LMArena Longer Query	1394	1273

Writing & Preference Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 60.9 (#94), Gemma 3 4B: 42.0 (#239)

Writing & Preference benchmarks
Benchmark	Gemini 3.1 Flash Lite	Gemma 3 4B
LMArena Text	1416	1291
LMArena Creative Writing	1401	1271
LMArena Multi-Turn	1417	1255
EQ-Bench Creative Writing	—	1068

Frequently asked questions

Is Gemini 3.1 Flash Lite better than Gemma 3 4B?

Which is cheaper, Gemini 3.1 Flash Lite or Gemma 3 4B?

Gemma 3 4B is cheaper. It lists at $0.04 per million input tokens and $0.08 per million output tokens; Gemini 3.1 Flash Lite lists at $0.25 and $1.50.

Is Gemini 3.1 Flash Lite or Gemma 3 4B better for coding?

Gemini 3.1 Flash Lite scores higher on coding benchmarks: 37.8 versus 35.9 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.1 Flash Lite does, with 1.05M tokens against 131K.

How many benchmarks do Gemini 3.1 Flash Lite and Gemma 3 4B share?

20 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and Gemma 3 4B has 22.