Model comparison

ERNIE 5.1 vs Palm 2

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 30.0 on the Noometry Index.

Last verified . 10 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Palm 2 Google

30.0

Rank #298 Confirmed

Summary

  • They share 10 benchmarks with published results for both. ERNIE 5.1 scores higher in 7 categories and Palm 2 in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.1 leads 65.1 to 25.6.

Side by side

ERNIE 5.1 and Palm 2 specifications
ERNIE 5.1Palm 2
ProviderBaiduGoogle
Noometry Index43.830.0
Released——
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1910

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.1 leads

ERNIE 5.1: 44.0 (#76), Palm 2: 29.0 (#311)

Coding benchmarks
BenchmarkERNIE 5.1Palm 2
LMArena Coding1488994

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Palm 2: —

Agentic & Tool Use benchmarks
BenchmarkERNIE 5.1Palm 2
LMArena Search1227—

Reasoning ERNIE 5.1 leads

ERNIE 5.1: 21.9 (#211), Palm 2: 19.1 (#271)

Reasoning benchmarks
BenchmarkERNIE 5.1Palm 2
LMArena Hard Prompts14811005
NYT Connections (extended)23.4%—

Math ERNIE 5.1 leads

ERNIE 5.1: 40.3 (#92), Palm 2: 30.8 (#231)

Math benchmarks
BenchmarkERNIE 5.1Palm 2
LMArena Math14811049

Knowledge Not comparable

ERNIE 5.1: 41.9 (#102), Palm 2: —

Knowledge benchmarks
BenchmarkERNIE 5.1Palm 2
LMArena Expert1492—

Multilingual ERNIE 5.1 leads

ERNIE 5.1: 55.5 (#29), Palm 2: 20.9 (#295)

Multilingual benchmarks
BenchmarkERNIE 5.1Palm 2
LMArena Non-English1454916
LMArena Chinese1508887
LMArena French1488—
LMArena German1470—
LMArena Japanese1422—
LMArena Korean1427—
LMArena Russian1459—
LMArena Spanish1473—

Instruction Following ERNIE 5.1 leads

ERNIE 5.1: 76.7 (#37), Palm 2: 51.0 (#296)

Instruction Following benchmarks
BenchmarkERNIE 5.1Palm 2
LMArena Instruction Following14601010

Long Context ERNIE 5.1 leads

ERNIE 5.1: 44.7 (#59), Palm 2: 30.8 (#285)

Long Context benchmarks
BenchmarkERNIE 5.1Palm 2
LMArena Longer Query14621010

Writing & Preference ERNIE 5.1 leads

ERNIE 5.1: 65.1 (#52), Palm 2: 25.6 (#304)

Writing & Preference benchmarks
BenchmarkERNIE 5.1Palm 2
LMArena Text14681027
LMArena Creative Writing1441991
LMArena Multi-Turn1471994

Frequently asked questions

Is ERNIE 5.1 better than Palm 2?

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 30.0 on the Noometry Index.

Is ERNIE 5.1 or Palm 2 better for coding?

ERNIE 5.1 scores higher on coding benchmarks: 44.0 versus 29.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Palm 2 share?

10 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Palm 2 has 10.

Related comparisons

Go deeper