Noometry

Model comparison

Gemma 3n E4b IT vs Phi-4 Mini

Gemma 3n E4b IT is the stronger model overall, scoring 37.3 to 30.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • The widest gap is in coding, where Gemma 3n E4b IT leads 37.0 to 28.1.

Side by side

Gemma 3n E4b ITPhi-4 Mini
ProviderGoogleMicrosoft
Noometry Index37.330.9
Released—2024-12-11
WeightsOpenOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.075
Output $ / M tokens—$0.30
Results tracked183

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 3n E4b IT leads

Gemma 3n E4b IT: 37.0 (#198), Phi-4 Mini: 28.1 (#317)

BenchmarkGemma 3n E4b ITPhi-4 Mini
SciCode—10.8%
LMArena Coding1268—

Reasoning Phi-4 Mini leads

Gemma 3n E4b IT: 19.9 (#247), Phi-4 Mini: 22.4 (#195)

BenchmarkGemma 3n E4b ITPhi-4 Mini
Kagi LLM Benchmark31.5%—
CritPt—0%
LMArena Hard Prompts1284—

Math Not comparable

Gemma 3n E4b IT: 35.1 (#188), Phi-4 Mini: —

BenchmarkGemma 3n E4b ITPhi-4 Mini
LMArena Math1251—

Knowledge Gemma 3n E4b IT leads

Gemma 3n E4b IT: 34.2 (#198), Phi-4 Mini: 25.3 (#262)

BenchmarkGemma 3n E4b ITPhi-4 Mini
Vectara Hallucination Rate—23.5%
LMArena Expert1246—

Multilingual Not comparable

Gemma 3n E4b IT: 43.4 (#183), Phi-4 Mini: —

BenchmarkGemma 3n E4b ITPhi-4 Mini
LMArena Non-English1285—
LMArena Chinese1309—
LMArena French1330—
LMArena German1311—
LMArena Japanese1272—
LMArena Korean1259—
LMArena Russian1288—
LMArena Spanish1305—

Instruction Following Not comparable

Gemma 3n E4b IT: 66.1 (#210), Phi-4 Mini: —

BenchmarkGemma 3n E4b ITPhi-4 Mini
LMArena Instruction Following1255—

Long Context Not comparable

Gemma 3n E4b IT: 38.7 (#191), Phi-4 Mini: —

BenchmarkGemma 3n E4b ITPhi-4 Mini
LMArena Longer Query1276—

Writing & Preference Not comparable

Gemma 3n E4b IT: 50.1 (#186), Phi-4 Mini: —

BenchmarkGemma 3n E4b ITPhi-4 Mini
LMArena Text1306—
LMArena Creative Writing1287—
LMArena Multi-Turn1276—

Frequently asked questions

Is Gemma 3n E4b IT better than Phi-4 Mini?

Gemma 3n E4b IT is the stronger model overall, scoring 37.3 to 30.9 on the Noometry Index.

Is Gemma 3n E4b IT or Phi-4 Mini better for coding?

Gemma 3n E4b IT scores higher on coding benchmarks: 37.0 versus 28.1 in the Noometry coding category.

How many benchmarks do Gemma 3n E4b IT and Phi-4 Mini share?

0 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper