Noometry

Model comparison

ERNIE 5.1 vs GPT-5 Mini

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 41.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

GPT-5 Mini OpenAI

41.8

Rank #128 Confirmed

Summary

  • They share 17 benchmarks with published results for both. ERNIE 5.1 scores higher in 5 categories and GPT-5 Mini in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.1 leads 65.1 to 55.2.

Side by side

ERNIE 5.1GPT-5 Mini
ProviderBaiduOpenAI
Noometry Index43.841.8
Released—2025-08-07
WeightsProprietaryProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$0.25
Output $ / M tokens—$2
Results tracked1960

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.1 leads

ERNIE 5.1: 44.0 (#76), GPT-5 Mini: 40.1 (#146)

BenchmarkERNIE 5.1GPT-5 Mini
LMArena Coding14881406
SWE-bench Verified—64.7%
SWE-bench Verified (bash only)—59.8%
SWE-bench Multilingual—39.7%
SciCode—39.2%
WeirdML—52.7%
ALE-Bench—799.77
AlgoTune—1.38

Agentic & Tool Use Not comparable

ERNIE 5.1: —, GPT-5 Mini: 31.1 (#70)

BenchmarkERNIE 5.1GPT-5 Mini
Terminal-Bench—34.8%
Berkeley Function Calling Leaderboard—55.5%
LMArena Search1227—
Vending-Bench 2—-31.18

Reasoning GPT-5 Mini leads

ERNIE 5.1: 21.9 (#211), GPT-5 Mini: 23.9 (#168)

BenchmarkERNIE 5.1GPT-5 Mini
LMArena Hard Prompts14811380
ARC-AGI-2—4.4%
Kagi LLM Benchmark—70.3%
NYT Connections (extended)23.4%—
ARC-AGI-1—54.3%
CritPt—0%
Chess Puzzles—30%
EnigmaEval—8.2%
Mystery Game Puzzles—10%
DTBench—80.5%
LMCA—34.2%
Epoch Capabilities Index—145.52
ForecastBench—61

Math GPT-5 Mini leads

ERNIE 5.1: 40.3 (#92), GPT-5 Mini: 46.7 (#69)

BenchmarkERNIE 5.1GPT-5 Mini
LMArena Math14811378
FrontierMath (Tiers 1-3)—46.7%
FrontierMath Tier 4—12.2%
OTIS Mock AIME 2024-2025—86.7%
ProofBench—9%
Omni-MATH—72.2%
MATH Level 5—97.8%
FrontierMath (Feb 2025 set)—27.2%
FrontierMath Tier 4 (v1)—6.3%

Knowledge GPT-5 Mini leads

ERNIE 5.1: 41.9 (#102), GPT-5 Mini: 45.6 (#86)

BenchmarkERNIE 5.1GPT-5 Mini
LMArena Expert14921379
GPQA Diamond—75%
Humanity's Last Exam—19.4%
SimpleQA Verified—21.6%
MMLU-Pro—83.5%
Confabulations—13.3%
Vectara Hallucination Rate—12.9%
GPQA (HELM)—75.6%

Multimodal Not comparable

ERNIE 5.1: —, GPT-5 Mini: 35.6 (#85)

BenchmarkERNIE 5.1GPT-5 Mini
LMArena Vision—1202
VPCT—40.2%

Multilingual ERNIE 5.1 leads

ERNIE 5.1: 55.5 (#29), GPT-5 Mini: 48.9 (#137)

BenchmarkERNIE 5.1GPT-5 Mini
LMArena Non-English14541363
LMArena Chinese15081385
LMArena French14881386
LMArena German14701366
LMArena Japanese14221341
LMArena Korean14271308
LMArena Russian14591362
LMArena Spanish14731355

Instruction Following Too close to call

ERNIE 5.1: 76.7 (#37), GPT-5 Mini: 76.2 (#46)

BenchmarkERNIE 5.1GPT-5 Mini
LMArena Instruction Following14601357
IFEval—92.7%

Long Context ERNIE 5.1 leads

ERNIE 5.1: 44.7 (#59), GPT-5 Mini: 41.9 (#132)

BenchmarkERNIE 5.1GPT-5 Mini
LMArena Longer Query14621355
Fiction.LiveBench—69.4%

Writing & Preference ERNIE 5.1 leads

ERNIE 5.1: 65.1 (#52), GPT-5 Mini: 55.2 (#148)

BenchmarkERNIE 5.1GPT-5 Mini
LMArena Text14681373
LMArena Creative Writing14411325
LMArena Multi-Turn14711363
Short-Story Creative Writing—83.1%
EQ-Bench Creative Writing—1313
WildBench—85.5%

Frequently asked questions

Is ERNIE 5.1 better than GPT-5 Mini?

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 41.8 on the Noometry Index.

Is ERNIE 5.1 or GPT-5 Mini better for coding?

ERNIE 5.1 scores higher on coding benchmarks: 44.0 versus 40.1 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and GPT-5 Mini share?

17 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and GPT-5 Mini has 60.

Related comparisons

Go deeper