Noometry

Model comparison

ERNIE 5.0 0110 vs GPT-4.1 nano

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 27.9 on the Noometry Index.

Last verified . 15 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

GPT-4.1 nano OpenAI

27.9

Rank #327 Confirmed

Summary

  • They share 15 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 9 categories and GPT-4.1 nano in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 40.5.

Side by side

ERNIE 5.0 0110GPT-4.1 nano
ProviderBaiduOpenAI
Noometry Index41.827.9
Released—2025-04-14
WeightsProprietaryProprietary
Context window—1.05M
Max output—33K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.40
Results tracked2038

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), GPT-4.1 nano: 24.1 (#330)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
LMArena Coding14551306
Aider Polyglot—8.9%
SciCode—25.9%
WeirdML—19%

Agentic & Tool Use Not comparable

ERNIE 5.0 0110: —, GPT-4.1 nano: 26.5 (#104)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
Berkeley Function Calling Leaderboard—33%

Reasoning ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 17.0 (#297), GPT-4.1 nano: 8.5 (#349)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
LMArena Hard Prompts14451286
ARC-AGI-2—0%
Kagi LLM Benchmark—33.3%
NYT Connections (extended)10.3%—
ARC-AGI-1—0%
CritPt—0%
Thematic Generalization41.7%—
DTBench—52.5%
LMCA—5.5%
Epoch Capabilities Index—129.62

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), GPT-4.1 nano: 26.9 (#252)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
LMArena Math14371274
OTIS Mock AIME 2024-2025—28.9%
Omni-MATH—36.7%
MATH Level 5—70%
FrontierMath (Feb 2025 set)—1%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), GPT-4.1 nano: 21.8 (#273)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
LMArena Expert14281272
GPQA Diamond—48.9%
SimpleQA Verified—6%
MMLU-Pro—55%
GPQA (HELM)—50.7%

Multimodal ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.9 (#53), GPT-4.1 nano: 29.2 (#113)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
LMArena Vision12491063

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), GPT-4.1 nano: 41.6 (#205)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
LMArena Non-English14361260
LMArena Chinese15121270
LMArena German14601288
LMArena Japanese13821198
LMArena Russian14461261
LMArena French1467—
LMArena Korean1406—
LMArena Spanish1473—

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), GPT-4.1 nano: 67.8 (#193)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
LMArena Instruction Following14131267
IFEval—84.3%

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), GPT-4.1 nano: 23.7 (#296)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
LMArena Longer Query14221283
Fiction.LiveBench—25%

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), GPT-4.1 nano: 40.5 (#243)

BenchmarkERNIE 5.0 0110GPT-4.1 nano
LMArena Text14451285
LMArena Creative Writing14261260
LMArena Multi-Turn14341277
EQ-Bench Creative Writing—946
WildBench—81.2%

Frequently asked questions

Is ERNIE 5.0 0110 better than GPT-4.1 nano?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 27.9 on the Noometry Index.

Is ERNIE 5.0 0110 or GPT-4.1 nano better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 24.1 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and GPT-4.1 nano share?

15 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and GPT-4.1 nano has 38.

Related comparisons

Go deeper