Noometry

Model comparison

ERNIE 5.1 vs Ministral 3B

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Summary

  • The widest gap is in knowledge, where ERNIE 5.1 leads 41.9 to 10.4.
  • Ministral 3B has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.1Ministral 3B
ProviderBaiduMistral AI
Noometry Index43.826.2
Released—2024-10-01
WeightsProprietaryOpen
Context window—131K
Max output—262K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.10
Results tracked196

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

ERNIE 5.1: 44.0 (#76), Ministral 3B: —

BenchmarkERNIE 5.1Ministral 3B
LMArena Coding1488—

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Ministral 3B: —

BenchmarkERNIE 5.1Ministral 3B
LMArena Search1227—

Reasoning ERNIE 5.1 leads

ERNIE 5.1: 21.9 (#211), Ministral 3B: 18.4 (#282)

BenchmarkERNIE 5.1Ministral 3B
NYT Connections (extended)23.4%—
LMArena Hard Prompts1481—
DTBench—51.7%
LMCA—5.5%
Epoch Capabilities Index—118.1

Math ERNIE 5.1 leads

ERNIE 5.1: 40.3 (#92), Ministral 3B: 26.6 (#258)

BenchmarkERNIE 5.1Ministral 3B
LMArena Math1481—
MATH Level 5—14.4%

Knowledge ERNIE 5.1 leads

ERNIE 5.1: 41.9 (#102), Ministral 3B: 10.4 (#302)

BenchmarkERNIE 5.1Ministral 3B
GPQA Diamond—25.3%
Vectara Hallucination Rate—7.3%
LMArena Expert1492—

Multilingual Not comparable

ERNIE 5.1: 55.5 (#29), Ministral 3B: —

BenchmarkERNIE 5.1Ministral 3B
LMArena Non-English1454—
LMArena Chinese1508—
LMArena French1488—
LMArena German1470—
LMArena Japanese1422—
LMArena Korean1427—
LMArena Russian1459—
LMArena Spanish1473—

Instruction Following Not comparable

ERNIE 5.1: 76.7 (#37), Ministral 3B: —

BenchmarkERNIE 5.1Ministral 3B
LMArena Instruction Following1460—

Long Context Not comparable

ERNIE 5.1: 44.7 (#59), Ministral 3B: —

BenchmarkERNIE 5.1Ministral 3B
LMArena Longer Query1462—

Writing & Preference Not comparable

ERNIE 5.1: 65.1 (#52), Ministral 3B: —

BenchmarkERNIE 5.1Ministral 3B
LMArena Text1468—
LMArena Creative Writing1441—
LMArena Multi-Turn1471—

Frequently asked questions

Is ERNIE 5.1 better than Ministral 3B?

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 26.2 on the Noometry Index.

How many benchmarks do ERNIE 5.1 and Ministral 3B share?

0 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Ministral 3B has 6.

Related comparisons

Go deeper