Noometry

Model comparison

ERNIE 5.0 0110 vs Mistral Small

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 33.4 on the Noometry Index.

Last verified . 18 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

Summary

  • They share 18 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 8 categories and Mistral Small in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where ERNIE 5.0 0110 leads 39.3 to 16.4.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110Mistral Small
ProviderBaiduMistral AI
Noometry Index41.833.4
Released—2024-02-26
WeightsProprietaryOpen
Context window—262K
Max output—256K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked2039

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Mistral Small: 34.0 (#247)

BenchmarkERNIE 5.0 0110Mistral Small
LMArena Coding14551362
SciCode—26.5%
BigCodeBench Instruct—36.1%
LiveBench Coding—36.2%
BigCodeBench Complete—46.6%
ALE-Bench—497.62

Agentic & Tool Use Not comparable

ERNIE 5.0 0110: —, Mistral Small: 28.1 (#93)

BenchmarkERNIE 5.0 0110Mistral Small
Berkeley Function Calling Leaderboard—37.1%

Reasoning Mistral Small leads

ERNIE 5.0 0110: 17.0 (#297), Mistral Small: 19.8 (#250)

BenchmarkERNIE 5.0 0110Mistral Small
LMArena Hard Prompts14451335
Kagi LLM Benchmark—37.8%
NYT Connections (extended)10.3%—
CritPt—0%
Thematic Generalization41.7%—
LiveBench Reasoning—44.8%
DTBench—70.9%
LiveBench Data Analysis—53.7%
LMCA—20.6%
LiveBench—44%

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Mistral Small: 16.4 (#293)

BenchmarkERNIE 5.0 0110Mistral Small
LMArena Math14371341
OTIS Mock AIME 2024-2025—5.8%
LiveBench Math—39.9%
MATH Level 5—46.8%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Mistral Small: 31.0 (#222)

BenchmarkERNIE 5.0 0110Mistral Small
LMArena Expert14281291
GPQA Diamond—47.5%
Vectara Hallucination Rate—5.1%
MMLU—68.7%

Multimodal ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.9 (#53), Mistral Small: 33.5 (#96)

BenchmarkERNIE 5.0 0110Mistral Small
LMArena Vision12491142

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Mistral Small: 45.5 (#169)

BenchmarkERNIE 5.0 0110Mistral Small
LMArena Non-English14361315
LMArena Chinese15121340
LMArena French14671337
LMArena German14601340
LMArena Japanese13821275
LMArena Korean14061259
LMArena Russian14461324
LMArena Spanish14731346

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Mistral Small: 66.4 (#209)

BenchmarkERNIE 5.0 0110Mistral Small
LMArena Instruction Following14131310
LiveBench Instruction Following—63.7%

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Mistral Small: 40.4 (#156)

BenchmarkERNIE 5.0 0110Mistral Small
LMArena Longer Query14221327

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Mistral Small: 52.5 (#171)

BenchmarkERNIE 5.0 0110Mistral Small
LMArena Text14451338
LMArena Creative Writing14261305
LMArena Multi-Turn14341344
LiveBench Language—30.5%

Frequently asked questions

Is ERNIE 5.0 0110 better than Mistral Small?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 33.4 on the Noometry Index.

Is ERNIE 5.0 0110 or Mistral Small better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 34.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Mistral Small share?

18 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Mistral Small has 39.

Related comparisons

Go deeper