Model comparison

Gemini 2.5 Flash-Lite vs Grok 4.20 Multi-Agent

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 37.0 on the Noometry Index. Gemini 2.5 Flash-Lite costs 8.9× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Last verified October 10, 2026. 18 shared benchmarks.

Gemini 2.5 Flash-Lite

Google

37.0

Rank #211 Confirmed

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Summary

They share 18 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 0 categories and Grok 4.20 Multi-Agent in 9 categories; 9 gaps are clear of the uncertainty.
The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 22.2.
Gemini 2.5 Flash-Lite is cheaper at $0.10 / $0.40 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.
Gemini 2.5 Flash-Lite accepts more context: 1.05M tokens versus 1M.

Side by side

Gemini 2.5 Flash-Lite and Grok 4.20 Multi-Agent specifications
	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
Provider	Google	xAI
Noometry Index	37.0	46.2
Released	2025-06-17	2026-03-09
Weights	Proprietary	Proprietary
Context window	1.05M	1M
Max output	66K	30K
Input $ / M tokens	$0.10	$1.25
Output $ / M tokens	$0.40	$2.50
Results tracked	33	20

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Gemini 2.5 Flash-Lite: 38.5 (#173), Grok 4.20 Multi-Agent: 43.0 (#92)

Coding benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
LMArena Coding	1373	1457
WeirdML	35.2%	—
ALE-Bench	325.9	—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash-Lite: 28.0 (#96), Grok 4.20 Multi-Agent: —

Agentic & Tool Use benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
Berkeley Function Calling Leaderboard	36.9%	—
LMArena Search	—	1204

Reasoning Grok 4.20 Multi-Agent leads

Gemini 2.5 Flash-Lite: 22.2 (#205), Grok 4.20 Multi-Agent: 43.9 (#48)

Reasoning benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
LMArena Hard Prompts	1377	1448
Kagi LLM Benchmark	40.5%	—
NYT Connections (extended)	—	89.6%
DTBench	62.8%	—
LMCA	18.1%	—
Epoch Capabilities Index	133.94	—

Math Grok 4.20 Multi-Agent leads

Gemini 2.5 Flash-Lite: 38.0 (#144), Grok 4.20 Multi-Agent: 39.4 (#104)

Math benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
LMArena Math	1373	1442
Omni-MATH	48%	—

Knowledge Grok 4.20 Multi-Agent leads

Gemini 2.5 Flash-Lite: 32.5 (#210), Grok 4.20 Multi-Agent: 40.4 (#119)

Knowledge benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
LMArena Expert	1373	1445
MMLU-Pro	53.7%	—
Vectara Hallucination Rate	3.3%	—
GPQA (HELM)	30.9%	—

Multimodal Grok 4.20 Multi-Agent leads

Gemini 2.5 Flash-Lite: 29.1 (#114), Grok 4.20 Multi-Agent: 40.5 (#48)

Multimodal benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
LMArena Vision	1198	1259
VPCT	30%	—

Multilingual Grok 4.20 Multi-Agent leads

Gemini 2.5 Flash-Lite: 49.3 (#134), Grok 4.20 Multi-Agent: 54.4 (#43)

Multilingual benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
LMArena Non-English	1369	1440
LMArena Chinese	1404	1475
LMArena French	1388	1466
LMArena German	1389	1456
LMArena Japanese	1359	1405
LMArena Korean	1360	1416
LMArena Russian	1373	1457
LMArena Spanish	1396	1447

Instruction Following Grok 4.20 Multi-Agent leads

Gemini 2.5 Flash-Lite: 70.0 (#168), Grok 4.20 Multi-Agent: 74.8 (#84)

Instruction Following benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
LMArena Instruction Following	1367	1420
IFEval	81%	—

Long Context Grok 4.20 Multi-Agent leads

Gemini 2.5 Flash-Lite: 33.3 (#262), Grok 4.20 Multi-Agent: 43.7 (#88)

Long Context benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
LMArena Longer Query	1373	1431
Fiction.LiveBench	47.2%	—

Writing & Preference Grok 4.20 Multi-Agent leads

Gemini 2.5 Flash-Lite: 56.8 (#135), Grok 4.20 Multi-Agent: 64.0 (#59)

Writing & Preference benchmarks
Benchmark	Gemini 2.5 Flash-Lite	Grok 4.20 Multi-Agent
LMArena Text	1379	1450
LMArena Creative Writing	1367	1436
LMArena Multi-Turn	1366	1452
WildBench	81.8%	—

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Grok 4.20 Multi-Agent?

Which is cheaper, Gemini 2.5 Flash-Lite or Grok 4.20 Multi-Agent?

Gemini 2.5 Flash-Lite is cheaper. It lists at $0.10 per million input tokens and $0.40 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is Gemini 2.5 Flash-Lite or Grok 4.20 Multi-Agent better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 43.0 versus 38.5 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash-Lite does, with 1.05M tokens against 1M.

How many benchmarks do Gemini 2.5 Flash-Lite and Grok 4.20 Multi-Agent share?

18 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Grok 4.20 Multi-Agent has 20.