Noometry

Model comparison

ERNIE 5.0 0110 vs Yi-1.5-34B

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 30.6 on the Noometry Index.

Last verified . 17 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Summary

  • They share 17 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 7 categories and Yi-1.5-34B in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 37.4.
  • Yi-1.5-34B has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110Yi-1.5-34B
ProviderBaidu01.AI
Noometry Index41.830.6
Released—2024-05-13
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2021

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Yi-1.5-34B: 32.4 (#272)

BenchmarkERNIE 5.0 0110Yi-1.5-34B
LMArena Coding14551169
BigCodeBench Instruct—33.9%
BigCodeBench Complete—43.8%

Reasoning Yi-1.5-34B leads

ERNIE 5.0 0110: 17.0 (#297), Yi-1.5-34B: 22.5 (#191)

BenchmarkERNIE 5.0 0110Yi-1.5-34B
LMArena Hard Prompts14451160
NYT Connections (extended)10.3%—
Thematic Generalization41.7%—

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Yi-1.5-34B: 27.5 (#249)

BenchmarkERNIE 5.0 0110Yi-1.5-34B
LMArena Math14371182
MATH Level 5—25.5%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Yi-1.5-34B: 14.8 (#295)

BenchmarkERNIE 5.0 0110Yi-1.5-34B
LMArena Expert14281144
GPQA Diamond—32%

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Yi-1.5-34B: —

BenchmarkERNIE 5.0 0110Yi-1.5-34B
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Yi-1.5-34B: 32.3 (#256)

BenchmarkERNIE 5.0 0110Yi-1.5-34B
LMArena Non-English14361121
LMArena Chinese15121213
LMArena French14671156
LMArena German14601111
LMArena Japanese13821021
LMArena Korean14061005
LMArena Russian14461091
LMArena Spanish14731121

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Yi-1.5-34B: 59.2 (#257)

BenchmarkERNIE 5.0 0110Yi-1.5-34B
LMArena Instruction Following14131139

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Yi-1.5-34B: 34.6 (#248)

BenchmarkERNIE 5.0 0110Yi-1.5-34B
LMArena Longer Query14221143

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Yi-1.5-34B: 37.4 (#257)

BenchmarkERNIE 5.0 0110Yi-1.5-34B
LMArena Text14451173
LMArena Creative Writing14261135
LMArena Multi-Turn14341153

Frequently asked questions

Is ERNIE 5.0 0110 better than Yi-1.5-34B?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 30.6 on the Noometry Index.

Is ERNIE 5.0 0110 or Yi-1.5-34B better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 32.4 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Yi-1.5-34B share?

17 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper