Model comparison

Palm 2 vs Phi-4 Mini

Palm 2 and Phi-4 Mini score almost the same on the Noometry Index (30.0 vs 30.9), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Palm 2 Google

30.0

Rank #298 Confirmed

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • The widest gap is in reasoning, where Phi-4 Mini leads 22.4 to 19.1.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

Palm 2 and Phi-4 Mini specifications
Palm 2Phi-4 Mini
ProviderGoogleMicrosoft
Noometry Index30.030.9
Released—2024-12-11
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.075
Output $ / M tokens—$0.30
Results tracked103

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Palm 2: 29.0 (#311), Phi-4 Mini: 28.1 (#317)

Coding benchmarks
BenchmarkPalm 2Phi-4 Mini
SciCode—10.8%
LMArena Coding994—

Reasoning Phi-4 Mini leads

Palm 2: 19.1 (#271), Phi-4 Mini: 22.4 (#195)

Reasoning benchmarks
BenchmarkPalm 2Phi-4 Mini
CritPt—0%
LMArena Hard Prompts1005—

Math Not comparable

Palm 2: 30.8 (#231), Phi-4 Mini: —

Math benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Math1049—

Knowledge Not comparable

Palm 2: —, Phi-4 Mini: 25.3 (#262)

Knowledge benchmarks
BenchmarkPalm 2Phi-4 Mini
Vectara Hallucination Rate—23.5%

Multilingual Not comparable

Palm 2: 20.9 (#295), Phi-4 Mini: —

Multilingual benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Non-English916—
LMArena Chinese887—

Instruction Following Not comparable

Palm 2: 51.0 (#296), Phi-4 Mini: —

Instruction Following benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Instruction Following1010—

Long Context Not comparable

Palm 2: 30.8 (#285), Phi-4 Mini: —

Long Context benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Longer Query1010—

Writing & Preference Not comparable

Palm 2: 25.6 (#304), Phi-4 Mini: —

Writing & Preference benchmarks
BenchmarkPalm 2Phi-4 Mini
LMArena Text1027—
LMArena Creative Writing991—
LMArena Multi-Turn994—

Frequently asked questions

Is Palm 2 better than Phi-4 Mini?

Palm 2 and Phi-4 Mini score almost the same on the Noometry Index (30.0 vs 30.9), so choose on price, context window or the category you care about most.

Is Palm 2 or Phi-4 Mini better for coding?

They score almost the same on coding (29.0 vs 28.1); test both on your own repository before choosing.

How many benchmarks do Palm 2 and Phi-4 Mini share?

0 benchmarks have published results for both models. Palm 2 has 10 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper