Model comparison

ERNIE 5.0 0110 vs Sonar

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 38.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 52.6.

Side by side

ERNIE 5.0 0110 and Sonar specifications
ERNIE 5.0 0110Sonar
ProviderBaiduPerplexity
Noometry Index41.838.5
Released—2024-01-01
WeightsProprietaryProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked207

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkERNIE 5.0 0110Sonar
LiveBench Coding—35.1%
LMArena Coding1455—

Reasoning Sonar leads

ERNIE 5.0 0110: 17.0 (#297), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkERNIE 5.0 0110Sonar
NYT Connections (extended)10.3%—
Thematic Generalization41.7%—
LiveBench Reasoning—46.3%
LMArena Hard Prompts1445—
LiveBench Data Analysis—37.9%
LiveBench—46.9%

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Sonar: 33.7 (#200)

Math benchmarks
BenchmarkERNIE 5.0 0110Sonar
LiveBench Math—41.6%
LMArena Math1437—

Knowledge Not comparable

ERNIE 5.0 0110: 39.8 (#128), Sonar: —

Knowledge benchmarks
BenchmarkERNIE 5.0 0110Sonar
LMArena Expert1428—

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Sonar: —

Multimodal benchmarks
BenchmarkERNIE 5.0 0110Sonar
LMArena Vision1249—

Multilingual Not comparable

ERNIE 5.0 0110: 54.1 (#49), Sonar: —

Multilingual benchmarks
BenchmarkERNIE 5.0 0110Sonar
LMArena Non-English1436—
LMArena Chinese1512—
LMArena French1467—
LMArena German1460—
LMArena Japanese1382—
LMArena Korean1406—
LMArena Russian1446—
LMArena Spanish1473—

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkERNIE 5.0 0110Sonar
LiveBench Instruction Following—76.2%
LMArena Instruction Following1413—

Long Context Not comparable

ERNIE 5.0 0110: 43.4 (#95), Sonar: —

Long Context benchmarks
BenchmarkERNIE 5.0 0110Sonar
LMArena Longer Query1422—

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkERNIE 5.0 0110Sonar
LMArena Text1445—
LMArena Creative Writing1426—
LMArena Multi-Turn1434—
LiveBench Language—44.1%

Frequently asked questions

Is ERNIE 5.0 0110 better than Sonar?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 38.5 on the Noometry Index.

Is ERNIE 5.0 0110 or Sonar better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 35.7 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Sonar share?

0 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper