Noometry

Model comparison

Gemini Advanced 0514 vs Phi-4

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 31.2 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Phi-4 Microsoft

31.2

Rank #279 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 8 categories and Phi-4 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini Advanced 0514 leads 35.5 to 20.8.
  • Phi-4 has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514Phi-4
ProviderGoogleMicrosoft
Noometry Index37.731.2
Released—2024-12-11
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.07
Output $ / M tokens—$0.14
Results tracked1737

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.6 (#205), Phi-4: 34.4 (#239)

BenchmarkGemini Advanced 0514Phi-4
LMArena Coding12551231
BigCodeBench Instruct—45.5%
LiveBench Coding—30.7%
BigCodeBench Complete—55.4%

Agentic & Tool Use Not comparable

Gemini Advanced 0514: —, Phi-4: 22.8 (#128)

BenchmarkGemini Advanced 0514Phi-4
Berkeley Function Calling Leaderboard—28.8%
BALROG—11.6%

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), Phi-4: 17.7 (#291)

BenchmarkGemini Advanced 0514Phi-4
LMArena Hard Prompts12481220
Chess Puzzles—1%
LiveBench Reasoning—47.8%
LiveBench Data Analysis—45.2%
Epoch Capabilities Index—130.42
LiveBench—41.6%

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), Phi-4: 20.8 (#285)

BenchmarkGemini Advanced 0514Phi-4
LMArena Math12721246
OTIS Mock AIME 2024-2025—13.8%
LiveBench Math—42%
MATH Level 5—64.9%

Knowledge Too close to call

Gemini Advanced 0514: 33.3 (#205), Phi-4: 32.6 (#209)

BenchmarkGemini Advanced 0514Phi-4
LMArena Expert12151203
GPQA Diamond—56.1%
Confabulations—29.4%
Vectara Hallucination Rate—3.7%
MMLU—84.8%

Multilingual Gemini Advanced 0514 leads

Gemini Advanced 0514: 42.6 (#192), Phi-4: 37.2 (#237)

BenchmarkGemini Advanced 0514Phi-4
LMArena Non-English12741197
LMArena Chinese12741212
LMArena French13071224
LMArena German12751222
LMArena Japanese12421158
LMArena Korean12321151
LMArena Russian12831209
LMArena Spanish12421234

Instruction Following Gemini Advanced 0514 leads

Gemini Advanced 0514: 66.0 (#212), Phi-4: 60.4 (#251)

BenchmarkGemini Advanced 0514Phi-4
LMArena Instruction Following12531201
LiveBench Instruction Following—58.4%

Long Context Gemini Advanced 0514 leads

Gemini Advanced 0514: 38.0 (#207), Phi-4: 36.9 (#226)

BenchmarkGemini Advanced 0514Phi-4
LMArena Longer Query12531217

Writing & Preference Gemini Advanced 0514 leads

Gemini Advanced 0514: 48.5 (#200), Phi-4: 40.5 (#244)

BenchmarkGemini Advanced 0514Phi-4
LMArena Text12791217
LMArena Creative Writing12841182
LMArena Multi-Turn12691206
Short-Story Creative Writing—62.6%
LiveBench Language—25.6%

Frequently asked questions

Is Gemini Advanced 0514 better than Phi-4?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 31.2 on the Noometry Index.

Is Gemini Advanced 0514 or Phi-4 better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 34.4 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Phi-4 share?

17 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Phi-4 has 37.

Related comparisons

Go deeper