Model comparison

ERNIE 5.0 0110 vs Gemini Advanced 0514

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 37.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Summary

  • They share 17 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 7 categories and Gemini Advanced 0514 in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 48.5.

Side by side

ERNIE 5.0 0110 and Gemini Advanced 0514 specifications
ERNIE 5.0 0110Gemini Advanced 0514
ProviderBaiduGoogle
Noometry Index41.837.7
Released——
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2017

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Gemini Advanced 0514: 36.6 (#205)

Coding benchmarks
BenchmarkERNIE 5.0 0110Gemini Advanced 0514
LMArena Coding14551255

Reasoning Gemini Advanced 0514 leads

ERNIE 5.0 0110: 17.0 (#297), Gemini Advanced 0514: 24.6 (#160)

Reasoning benchmarks
BenchmarkERNIE 5.0 0110Gemini Advanced 0514
LMArena Hard Prompts14451248
NYT Connections (extended)10.3%—
Thematic Generalization41.7%—

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Gemini Advanced 0514: 35.5 (#181)

Math benchmarks
BenchmarkERNIE 5.0 0110Gemini Advanced 0514
LMArena Math14371272

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Gemini Advanced 0514: 33.3 (#205)

Knowledge benchmarks
BenchmarkERNIE 5.0 0110Gemini Advanced 0514
LMArena Expert14281215

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Gemini Advanced 0514: —

Multimodal benchmarks
BenchmarkERNIE 5.0 0110Gemini Advanced 0514
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Gemini Advanced 0514: 42.6 (#192)

Multilingual benchmarks
BenchmarkERNIE 5.0 0110Gemini Advanced 0514
LMArena Non-English14361274
LMArena Chinese15121274
LMArena French14671307
LMArena German14601275
LMArena Japanese13821242
LMArena Korean14061232
LMArena Russian14461283
LMArena Spanish14731242

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Gemini Advanced 0514: 66.0 (#212)

Instruction Following benchmarks
BenchmarkERNIE 5.0 0110Gemini Advanced 0514
LMArena Instruction Following14131253

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Gemini Advanced 0514: 38.0 (#207)

Long Context benchmarks
BenchmarkERNIE 5.0 0110Gemini Advanced 0514
LMArena Longer Query14221253

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Gemini Advanced 0514: 48.5 (#200)

Writing & Preference benchmarks
BenchmarkERNIE 5.0 0110Gemini Advanced 0514
LMArena Text14451279
LMArena Creative Writing14261284
LMArena Multi-Turn14341269

Frequently asked questions

Is ERNIE 5.0 0110 better than Gemini Advanced 0514?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 37.7 on the Noometry Index.

Is ERNIE 5.0 0110 or Gemini Advanced 0514 better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 36.6 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Gemini Advanced 0514 share?

17 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Gemini Advanced 0514 has 17.

Related comparisons

Go deeper