Noometry

Model comparison

DBRX vs ERNIE 5.0 0110

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 29.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

DBRX Databricks

29.4

Rank #311 Confirmed

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Summary

  • They share 17 benchmarks with published results for both. DBRX scores higher in 1 category and ERNIE 5.0 0110 in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 33.6.
  • DBRX has downloadable open weights; the other is API-only.

Side by side

DBRXERNIE 5.0 0110
ProviderDatabricksBaidu
Noometry Index29.441.8
Released2024-03-27—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2120

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

DBRX: 32.9 (#266), ERNIE 5.0 0110: 43.0 (#94)

BenchmarkDBRXERNIE 5.0 0110
LMArena Coding11321455
HumanEval+70.1%—
MBPP+55.8%—

Reasoning DBRX leads

DBRX: 21.4 (#222), ERNIE 5.0 0110: 17.0 (#297)

BenchmarkDBRXERNIE 5.0 0110
LMArena Hard Prompts11131445
NYT Connections (extended)—10.3%
Thematic Generalization—41.7%

Math ERNIE 5.0 0110 leads

DBRX: 24.3 (#269), ERNIE 5.0 0110: 39.3 (#110)

BenchmarkDBRXERNIE 5.0 0110
LMArena Math11451437
MATH Level 511.7%—

Knowledge ERNIE 5.0 0110 leads

DBRX: 14.9 (#294), ERNIE 5.0 0110: 39.8 (#128)

BenchmarkDBRXERNIE 5.0 0110
LMArena Expert10761428
GPQA Diamond32.9%—

Multimodal Not comparable

DBRX: —, ERNIE 5.0 0110: 39.9 (#53)

BenchmarkDBRXERNIE 5.0 0110
LMArena Vision—1249

Multilingual ERNIE 5.0 0110 leads

DBRX: 29.3 (#268), ERNIE 5.0 0110: 54.1 (#49)

BenchmarkDBRXERNIE 5.0 0110
LMArena Non-English10711436
LMArena Chinese10681512
LMArena French10961467
LMArena German10571460
LMArena Japanese9901382
LMArena Korean9931406
LMArena Russian10781446
LMArena Spanish10641473

Instruction Following ERNIE 5.0 0110 leads

DBRX: 57.5 (#270), ERNIE 5.0 0110: 74.5 (#92)

BenchmarkDBRXERNIE 5.0 0110
LMArena Instruction Following11121413

Long Context ERNIE 5.0 0110 leads

DBRX: 33.7 (#258), ERNIE 5.0 0110: 43.4 (#95)

BenchmarkDBRXERNIE 5.0 0110
LMArena Longer Query11121422

Writing & Preference ERNIE 5.0 0110 leads

DBRX: 33.6 (#275), ERNIE 5.0 0110: 63.1 (#66)

BenchmarkDBRXERNIE 5.0 0110
LMArena Text11191445
LMArena Creative Writing11041426
LMArena Multi-Turn11111434

Frequently asked questions

Is DBRX better than ERNIE 5.0 0110?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 29.4 on the Noometry Index.

Is DBRX or ERNIE 5.0 0110 better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 32.9 in the Noometry coding category.

How many benchmarks do DBRX and ERNIE 5.0 0110 share?

17 benchmarks have published results for both models. DBRX has 21 scored results on Noometry and ERNIE 5.0 0110 has 20.

Related comparisons

Go deeper