Model comparison

ERNIE 5.1 vs Mercury 2.5

ERNIE 5.1 has enough public results to be ranked (#87); Mercury 2.5 does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

ERNIE 5.1 Baidu

43.1

Rank #87 Confirmed

Mercury 2.5 Inception

30.2

Unranked Sparse

Summary

  • The widest gap is in math, where ERNIE 5.1 leads 37.5 to 22.4.

Side by side

ERNIE 5.1 and Mercury 2.5 specifications
ERNIE 5.1Mercury 2.5
ProviderBaiduInception
Noometry Index43.130.2
Released—2026-09-08
WeightsProprietaryProprietary
Context window—260K
Max output—66K
Input $ / M tokens—$0.04
Output $ / M tokens—$0.15
Results tracked192

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

ERNIE 5.1: 43.4 (#78), Mercury 2.5: —

Coding benchmarks
BenchmarkERNIE 5.1Mercury 2.5
LMArena Coding1488—
ALE-Bench—301.65

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Mercury 2.5: —

Agentic & Tool Use benchmarks
BenchmarkERNIE 5.1Mercury 2.5
LMArena Search1227—

Reasoning Not comparable

ERNIE 5.1: 20.9 (#209), Mercury 2.5: —

Reasoning benchmarks
BenchmarkERNIE 5.1Mercury 2.5
NYT Connections (extended)23.4%—
LMArena Hard Prompts1481—

Math ERNIE 5.1 leads

ERNIE 5.1: 37.5 (#96), Mercury 2.5: 22.4

Math benchmarks
BenchmarkERNIE 5.1Mercury 2.5
ProofBench—3%
LMArena Math1481—

Knowledge Not comparable

ERNIE 5.1: 41.2 (#103), Mercury 2.5: —

Knowledge benchmarks
BenchmarkERNIE 5.1Mercury 2.5
LMArena Expert1491—

Multilingual Not comparable

ERNIE 5.1: 55.7 (#28), Mercury 2.5: —

Multilingual benchmarks
BenchmarkERNIE 5.1Mercury 2.5
LMArena Non-English1455—
LMArena Chinese1507—
LMArena French1486—
LMArena German1470—
LMArena Japanese1422—
LMArena Korean1428—
LMArena Russian1459—
LMArena Spanish1472—

Instruction Following Not comparable

ERNIE 5.1: 76.9 (#35), Mercury 2.5: —

Instruction Following benchmarks
BenchmarkERNIE 5.1Mercury 2.5
LMArena Instruction Following1460—

Long Context Not comparable

ERNIE 5.1: 44.7 (#56), Mercury 2.5: —

Long Context benchmarks
BenchmarkERNIE 5.1Mercury 2.5
LMArena Longer Query1462—

Writing & Preference Not comparable

ERNIE 5.1: 65.3 (#50), Mercury 2.5: —

Writing & Preference benchmarks
BenchmarkERNIE 5.1Mercury 2.5
LMArena Text1468—
LMArena Creative Writing1440—
LMArena Multi-Turn1471—

Frequently asked questions

Is ERNIE 5.1 better than Mercury 2.5?

ERNIE 5.1 has enough public results to be ranked (#87); Mercury 2.5 does not yet, so treat this comparison as directional.

How many benchmarks do ERNIE 5.1 and Mercury 2.5 share?

0 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Mercury 2.5 has 2.

Related comparisons

Go deeper