Noometry

Model comparison

Gemini 3.1 Flash Lite vs Phi-4 Mini

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 30.9 on the Noometry Index. Phi-4 Mini costs 4.3× less per token, which makes it the better buy when Gemini 3.1 Flash Lite's lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

Gemini 3.1 Flash Lite Google

40.8

Rank #144 Confirmed

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • They share 3 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 3 categories and Phi-4 Mini in 0 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3.1 Flash Lite leads 41.9 to 25.3.
  • The biggest single-benchmark swing is SciCode: 41.9% for Gemini 3.1 Flash Lite and 10.8% for Phi-4 Mini.
  • Phi-4 Mini is cheaper at $0.075 / $0.30 per million input/output tokens, against $0.25 / $1.50 for Gemini 3.1 Flash Lite.
  • Gemini 3.1 Flash Lite accepts more context: 1.05M tokens versus 128K.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

Gemini 3.1 Flash LitePhi-4 Mini
ProviderGoogleMicrosoft
Noometry Index40.830.9
Released2026-03-032024-12-11
WeightsProprietaryOpen
Context window1.05M128K
Max output66K4K
Input $ / M tokens$0.25$0.075
Output $ / M tokens$1.50$0.30
Results tracked383

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 37.8 (#188), Phi-4 Mini: 28.1 (#317)

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
SciCode41.9%10.8%
LMArena WebDev1256—
WeirdML52.2%—
LMArena Coding1400—
ALE-Bench797.73—

Agentic & Tool Use Not comparable

Gemini 3.1 Flash Lite: 30.2 (#79), Phi-4 Mini: —

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
DeepResearch Bench37.3%—

Reasoning Too close to call

Gemini 3.1 Flash Lite: 22.9 (#186), Phi-4 Mini: 22.4 (#195)

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
CritPt1.1%0%
Kagi LLM Benchmark67.2%—
NYT Connections (extended)8.2%—
Chess Puzzles25%—
EnigmaEval3%—
Thematic Generalization63.3%—
LMArena Hard Prompts1407—
DTBench76.8%—
LMCA35%—
Epoch Capabilities Index144.47—
ForecastBench54.4—

Math Not comparable

Gemini 3.1 Flash Lite: 40.7 (#90), Phi-4 Mini: —

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
FrontierMath (Tiers 1-3)27.7%—
OTIS Mock AIME 2024-202580%—
LMArena Math1428—

Knowledge Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 41.9 (#104), Phi-4 Mini: 25.3 (#262)

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
Vectara Hallucination Rate8.2%23.5%
GPQA Diamond81.8%—
Humanity's Last Exam8.6%—
LMArena Expert1398—

Multimodal Not comparable

Gemini 3.1 Flash Lite: 39.4 (#60), Phi-4 Mini: —

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
LMArena Vision1240—

Multilingual Not comparable

Gemini 3.1 Flash Lite: 52.3 (#86), Phi-4 Mini: —

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
LMArena Non-English1411—
LMArena Chinese1461—
LMArena French1424—
LMArena German1429—
LMArena Japanese1413—
LMArena Korean1392—
LMArena Russian1420—
LMArena Spanish1421—

Instruction Following Not comparable

Gemini 3.1 Flash Lite: 72.7 (#131), Phi-4 Mini: —

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
LMArena Instruction Following1377—

Long Context Not comparable

Gemini 3.1 Flash Lite: 42.5 (#122), Phi-4 Mini: —

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
LMArena Longer Query1394—

Writing & Preference Not comparable

Gemini 3.1 Flash Lite: 60.9 (#94), Phi-4 Mini: —

BenchmarkGemini 3.1 Flash LitePhi-4 Mini
LMArena Text1416—
LMArena Creative Writing1401—
LMArena Multi-Turn1417—

Frequently asked questions

Is Gemini 3.1 Flash Lite better than Phi-4 Mini?

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 30.9 on the Noometry Index. Phi-4 Mini costs 4.3× less per token, which makes it the better buy when Gemini 3.1 Flash Lite's lead doesn't matter for your workload.

Which is cheaper, Gemini 3.1 Flash Lite or Phi-4 Mini?

Phi-4 Mini is cheaper. It lists at $0.075 per million input tokens and $0.30 per million output tokens; Gemini 3.1 Flash Lite lists at $0.25 and $1.50.

Is Gemini 3.1 Flash Lite or Phi-4 Mini better for coding?

Gemini 3.1 Flash Lite scores higher on coding benchmarks: 37.8 versus 28.1 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.1 Flash Lite does, with 1.05M tokens against 128K.

How many benchmarks do Gemini 3.1 Flash Lite and Phi-4 Mini share?

3 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper