Noometry

Model comparison

Gemini 3.5 Flash Lite vs Phi-4 Mini

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.5 to 30.9 on the Noometry Index. Phi-4 Mini costs 6.5× less per token, which makes it the better buy when Gemini 3.5 Flash Lite's lead doesn't matter for your workload.

Last verified . 2 shared benchmarks.

Gemini 3.5 Flash Lite Google

41.5

Rank #133 Confirmed

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • They share 2 benchmarks with published results for both. Gemini 3.5 Flash Lite scores higher in 3 categories and Phi-4 Mini in 0 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.5 Flash Lite leads 50.1 to 25.3.
  • The biggest single-benchmark swing is SciCode: 41.3% for Gemini 3.5 Flash Lite and 10.8% for Phi-4 Mini.
  • Phi-4 Mini is cheaper at $0.075 / $0.30 per million input/output tokens, against $0.30 / $2.50 for Gemini 3.5 Flash Lite.
  • Gemini 3.5 Flash Lite accepts more context: 1.05M tokens versus 128K.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

Gemini 3.5 Flash LitePhi-4 Mini
ProviderGoogleMicrosoft
Noometry Index41.530.9
Released2026-07-212024-12-11
WeightsProprietaryOpen
Context window1.05M128K
Max output66K4K
Input $ / M tokens$0.30$0.075
Output $ / M tokens$2.50$0.30
Results tracked393

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 42.4 (#104), Phi-4 Mini: 28.1 (#317)

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
SciCode41.3%10.8%
LMArena WebDev1440—
WeirdML39%—
LMArena Coding1453—
ALE-Bench765.27—

Agentic & Tool Use Not comparable

Gemini 3.5 Flash Lite: 25.7 (#107), Phi-4 Mini: —

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
APEX-Agents29.3%—
GDP.pdf10%—

Reasoning Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 27.8 (#114), Phi-4 Mini: 22.4 (#195)

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
CritPt0%0%
ARC-AGI-210.3%—
NYT Connections (extended)60.4%—
ARC-AGI-153.5%—
Chess Puzzles22%—
LMArena Hard Prompts1441—
Mystery Game Puzzles19%—
DTBench83.5%—
LMCA37.6%—
Epoch Capabilities Index145.13—

Math Not comparable

Gemini 3.5 Flash Lite: 25.9 (#264), Phi-4 Mini: —

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
FrontierMath (Tiers 1-3)26%—
FrontierMath Tier 40%—
OTIS Mock AIME 2024-202571.1%—
ProofBench13%—
LMArena Math1433—

Knowledge Gemini 3.5 Flash Lite leads

Gemini 3.5 Flash Lite: 50.1 (#72), Phi-4 Mini: 25.3 (#262)

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
GPQA Diamond83.3%—
Vectara Hallucination Rate—23.5%
LMArena Expert1435—

Multimodal Not comparable

Gemini 3.5 Flash Lite: 41.1 (#40), Phi-4 Mini: —

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
LMArena Vision1268—

Multilingual Not comparable

Gemini 3.5 Flash Lite: 53.5 (#63), Phi-4 Mini: —

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
LMArena Non-English1427—
LMArena Chinese1469—
LMArena French1451—
LMArena German1454—
LMArena Japanese1427—
LMArena Korean1407—
LMArena Russian1443—
LMArena Spanish1442—

Instruction Following Not comparable

Gemini 3.5 Flash Lite: 74.8 (#85), Phi-4 Mini: —

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
LMArena Instruction Following1420—

Long Context Not comparable

Gemini 3.5 Flash Lite: 43.9 (#84), Phi-4 Mini: —

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
LMArena Longer Query1435—

Writing & Preference Not comparable

Gemini 3.5 Flash Lite: 64.2 (#57), Phi-4 Mini: —

BenchmarkGemini 3.5 Flash LitePhi-4 Mini
LMArena Text1435—
LMArena Creative Writing1420—
EQ-Bench Creative Writing1559—
LMArena Multi-Turn1445—

Frequently asked questions

Is Gemini 3.5 Flash Lite better than Phi-4 Mini?

Gemini 3.5 Flash Lite is the stronger model overall, scoring 41.5 to 30.9 on the Noometry Index. Phi-4 Mini costs 6.5× less per token, which makes it the better buy when Gemini 3.5 Flash Lite's lead doesn't matter for your workload.

Which is cheaper, Gemini 3.5 Flash Lite or Phi-4 Mini?

Phi-4 Mini is cheaper. It lists at $0.075 per million input tokens and $0.30 per million output tokens; Gemini 3.5 Flash Lite lists at $0.30 and $2.50.

Is Gemini 3.5 Flash Lite or Phi-4 Mini better for coding?

Gemini 3.5 Flash Lite scores higher on coding benchmarks: 42.4 versus 28.1 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.5 Flash Lite does, with 1.05M tokens against 128K.

How many benchmarks do Gemini 3.5 Flash Lite and Phi-4 Mini share?

2 benchmarks have published results for both models. Gemini 3.5 Flash Lite has 39 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper