Noometry

Model comparison

ERNIE 5.0 0110 vs Ministral 3B

ERNIE 5.0 0110 is the stronger model overall, scoring 41.2 to 25.6 on the Noometry Index.

Last verified . 0 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.2

Rank #129 Confirmed

Ministral 3B Mistral AI

25.6

Rank #336 Confirmed

Summary

  • The widest gap is in knowledge, where ERNIE 5.0 0110 leads 39.2 to 10.4.
  • Ministral 3B has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110Ministral 3B
ProviderBaiduMistral AI
Noometry Index41.225.6
Released—2024-10-01
WeightsProprietaryOpen
Context window—128K
Max output—128K
Input $ / M tokens—$0.04
Output $ / M tokens—$0.04
Results tracked206

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

ERNIE 5.0 0110: 42.3 (#94), Ministral 3B: —

BenchmarkERNIE 5.0 0110Ministral 3B
LMArena Coding1455—

Reasoning Ministral 3B leads

ERNIE 5.0 0110: 16.3 (#296), Ministral 3B: 17.7 (#278)

BenchmarkERNIE 5.0 0110Ministral 3B
NYT Connections (extended)10.3%—
Thematic Generalization41.7%—
LMArena Hard Prompts1446—
DTBench—51.7%
LMCA—5.5%
Epoch Capabilities Index—118.08

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 36.5 (#111), Ministral 3B: 24.5 (#257)

BenchmarkERNIE 5.0 0110Ministral 3B
LMArena Math1437—
MATH Level 5—14.4%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.2 (#125), Ministral 3B: 10.4 (#297)

BenchmarkERNIE 5.0 0110Ministral 3B
GPQA Diamond—25.3%
Vectara Hallucination Rate—7.3%
LMArena Expert1427—

Multimodal Not comparable

ERNIE 5.0 0110: 39.1 (#49), Ministral 3B: —

BenchmarkERNIE 5.0 0110Ministral 3B
LMArena Vision1248—

Multilingual Not comparable

ERNIE 5.0 0110: 54.3 (#47), Ministral 3B: —

BenchmarkERNIE 5.0 0110Ministral 3B
LMArena Non-English1436—
LMArena Chinese1512—
LMArena French1466—
LMArena German1462—
LMArena Japanese1383—
LMArena Korean1406—
LMArena Russian1446—
LMArena Spanish1473—

Instruction Following Not comparable

ERNIE 5.0 0110: 74.7 (#88), Ministral 3B: —

BenchmarkERNIE 5.0 0110Ministral 3B
LMArena Instruction Following1413—

Long Context Not comparable

ERNIE 5.0 0110: 43.4 (#90), Ministral 3B: —

BenchmarkERNIE 5.0 0110Ministral 3B
LMArena Longer Query1422—

Writing & Preference Not comparable

ERNIE 5.0 0110: 63.4 (#64), Ministral 3B: —

BenchmarkERNIE 5.0 0110Ministral 3B
LMArena Text1445—
LMArena Creative Writing1426—
LMArena Multi-Turn1433—

Frequently asked questions

Is ERNIE 5.0 0110 better than Ministral 3B?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.2 to 25.6 on the Noometry Index.

How many benchmarks do ERNIE 5.0 0110 and Ministral 3B share?

0 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Ministral 3B has 6.

Related comparisons

Go deeper