Model comparison

ERNIE 5.0 0110 vs Mercury 2

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 39.1 on the Noometry Index.

Last verified . 11 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Mercury 2 Inception

39.1

Rank #175 Confirmed

Summary

  • They share 11 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 6 categories and Mercury 2 in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in coding, where ERNIE 5.0 0110 leads 43.0 to 33.5.

Side by side

ERNIE 5.0 0110 and Mercury 2 specifications
ERNIE 5.0 0110Mercury 2
ProviderBaiduInception
Noometry Index41.839.1
Released—2026-02-20
WeightsProprietaryProprietary
Context window—128K
Max output—50K
Input $ / M tokens—$0.25
Output $ / M tokens—$0.75
Results tracked2017

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Mercury 2: 33.5 (#255)

Coding benchmarks
BenchmarkERNIE 5.0 0110Mercury 2
LMArena Coding14551391
LMArena WebDev—1171
SciCode—38.7%
WeirdML—43.2%
ALE-Bench—785.58

Reasoning Mercury 2 leads

ERNIE 5.0 0110: 17.0 (#297), Mercury 2: 23.8 (#170)

Reasoning benchmarks
BenchmarkERNIE 5.0 0110Mercury 2
LMArena Hard Prompts14451362
NYT Connections (extended)10.3%—
CritPt—0.8%
Thematic Generalization41.7%—

Math Not comparable

ERNIE 5.0 0110: 39.3 (#110), Mercury 2: —

Math benchmarks
BenchmarkERNIE 5.0 0110Mercury 2
LMArena Math1437—

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Mercury 2: 36.2 (#172)

Knowledge benchmarks
BenchmarkERNIE 5.0 0110Mercury 2
LMArena Expert14281358
Vectara Hallucination Rate—12.3%

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Mercury 2: —

Multimodal benchmarks
BenchmarkERNIE 5.0 0110Mercury 2
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Mercury 2: 46.6 (#157)

Multilingual benchmarks
BenchmarkERNIE 5.0 0110Mercury 2
LMArena Non-English14361331
LMArena Chinese15121417
LMArena Russian14461304
LMArena French1467—
LMArena German1460—
LMArena Japanese1382—
LMArena Korean1406—
LMArena Spanish1473—

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Mercury 2: 70.2 (#165)

Instruction Following benchmarks
BenchmarkERNIE 5.0 0110Mercury 2
LMArena Instruction Following14131329

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Mercury 2: 40.5 (#154)

Long Context benchmarks
BenchmarkERNIE 5.0 0110Mercury 2
LMArena Longer Query14221330

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Mercury 2: 53.8 (#155)

Writing & Preference benchmarks
BenchmarkERNIE 5.0 0110Mercury 2
LMArena Text14451355
LMArena Creative Writing14261289
LMArena Multi-Turn14341358

Frequently asked questions

Is ERNIE 5.0 0110 better than Mercury 2?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 39.1 on the Noometry Index.

Is ERNIE 5.0 0110 or Mercury 2 better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 33.5 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Mercury 2 share?

11 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Mercury 2 has 17.

Related comparisons

Go deeper