Noometry

Model comparison

ERNIE 5.0 0110 vs Pixtral Large

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 32.2 on the Noometry Index.

Last verified . 1 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • They share 1 benchmark with published results for both. ERNIE 5.0 0110 scores higher in 2 categories and Pixtral Large in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 32.9.
  • Pixtral Large has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110Pixtral Large
ProviderBaiduMistral AI
Noometry Index41.832.2
Released—2024-11-01
WeightsProprietaryOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked203

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

ERNIE 5.0 0110: 43.0 (#94), Pixtral Large: —

BenchmarkERNIE 5.0 0110Pixtral Large
LMArena Coding1455—

Reasoning Pixtral Large leads

ERNIE 5.0 0110: 17.0 (#297), Pixtral Large: 21.7 (#218)

BenchmarkERNIE 5.0 0110Pixtral Large
NYT Connections (extended)10.3%—
EnigmaEval—0.8%
Thematic Generalization41.7%—
LMArena Hard Prompts1445—

Math Not comparable

ERNIE 5.0 0110: 39.3 (#110), Pixtral Large: —

BenchmarkERNIE 5.0 0110Pixtral Large
LMArena Math1437—

Knowledge Not comparable

ERNIE 5.0 0110: 39.8 (#128), Pixtral Large: —

BenchmarkERNIE 5.0 0110Pixtral Large
LMArena Expert1428—

Multimodal ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.9 (#53), Pixtral Large: 30.6 (#111)

BenchmarkERNIE 5.0 0110Pixtral Large
LMArena Vision12491089

Multilingual Not comparable

ERNIE 5.0 0110: 54.1 (#49), Pixtral Large: —

BenchmarkERNIE 5.0 0110Pixtral Large
LMArena Non-English1436—
LMArena Chinese1512—
LMArena French1467—
LMArena German1460—
LMArena Japanese1382—
LMArena Korean1406—
LMArena Russian1446—
LMArena Spanish1473—

Instruction Following Not comparable

ERNIE 5.0 0110: 74.5 (#92), Pixtral Large: —

BenchmarkERNIE 5.0 0110Pixtral Large
LMArena Instruction Following1413—

Long Context Not comparable

ERNIE 5.0 0110: 43.4 (#95), Pixtral Large: —

BenchmarkERNIE 5.0 0110Pixtral Large
LMArena Longer Query1422—

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Pixtral Large: 32.9 (#278)

BenchmarkERNIE 5.0 0110Pixtral Large
LMArena Text1445—
LMArena Creative Writing1426—
EQ-Bench Creative Writing—988
LMArena Multi-Turn1434—

Frequently asked questions

Is ERNIE 5.0 0110 better than Pixtral Large?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 32.2 on the Noometry Index.

How many benchmarks do ERNIE 5.0 0110 and Pixtral Large share?

1 benchmark has published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper