Noometry

Model comparison

ERNIE 5.0 0110 vs Phi-4

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 31.2 on the Noometry Index.

Last verified . 17 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Phi-4 Microsoft

31.2

Rank #279 Confirmed

Summary

  • They share 17 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 7 categories and Phi-4 in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 40.5.
  • Phi-4 has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110Phi-4
ProviderBaiduMicrosoft
Noometry Index41.831.2
Released—2024-12-11
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.07
Output $ / M tokens—$0.14
Results tracked2037

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Phi-4: 34.4 (#239)

BenchmarkERNIE 5.0 0110Phi-4
LMArena Coding14551231
BigCodeBench Instruct—45.5%
LiveBench Coding—30.7%
BigCodeBench Complete—55.4%

Agentic & Tool Use Not comparable

ERNIE 5.0 0110: —, Phi-4: 22.8 (#128)

BenchmarkERNIE 5.0 0110Phi-4
Berkeley Function Calling Leaderboard—28.8%
BALROG—11.6%

Reasoning Too close to call

ERNIE 5.0 0110: 17.0 (#297), Phi-4: 17.7 (#291)

BenchmarkERNIE 5.0 0110Phi-4
LMArena Hard Prompts14451220
NYT Connections (extended)10.3%—
Chess Puzzles—1%
Thematic Generalization41.7%—
LiveBench Reasoning—47.8%
LiveBench Data Analysis—45.2%
Epoch Capabilities Index—130.42
LiveBench—41.6%

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Phi-4: 20.8 (#285)

BenchmarkERNIE 5.0 0110Phi-4
LMArena Math14371246
OTIS Mock AIME 2024-2025—13.8%
LiveBench Math—42%
MATH Level 5—64.9%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Phi-4: 32.6 (#209)

BenchmarkERNIE 5.0 0110Phi-4
LMArena Expert14281203
GPQA Diamond—56.1%
Confabulations—29.4%
Vectara Hallucination Rate—3.7%
MMLU—84.8%

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Phi-4: —

BenchmarkERNIE 5.0 0110Phi-4
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Phi-4: 37.2 (#237)

BenchmarkERNIE 5.0 0110Phi-4
LMArena Non-English14361197
LMArena Chinese15121212
LMArena French14671224
LMArena German14601222
LMArena Japanese13821158
LMArena Korean14061151
LMArena Russian14461209
LMArena Spanish14731234

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Phi-4: 60.4 (#251)

BenchmarkERNIE 5.0 0110Phi-4
LMArena Instruction Following14131201
LiveBench Instruction Following—58.4%

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Phi-4: 36.9 (#226)

BenchmarkERNIE 5.0 0110Phi-4
LMArena Longer Query14221217

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Phi-4: 40.5 (#244)

BenchmarkERNIE 5.0 0110Phi-4
LMArena Text14451217
LMArena Creative Writing14261182
LMArena Multi-Turn14341206
Short-Story Creative Writing—62.6%
LiveBench Language—25.6%

Frequently asked questions

Is ERNIE 5.0 0110 better than Phi-4?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 31.2 on the Noometry Index.

Is ERNIE 5.0 0110 or Phi-4 better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 34.4 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Phi-4 share?

17 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Phi-4 has 37.

Related comparisons

Go deeper