Model comparison

DeepSeek-R1 vs ERNIE 5.0 0110

DeepSeek-R1 and ERNIE 5.0 0110 score almost the same on the Noometry Index (42.3 vs 41.8), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

DeepSeek-R1 DeepSeek

42.3

Rank #115 Confirmed

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Summary

  • They share 17 benchmarks with published results for both. DeepSeek-R1 scores higher in 5 categories and ERNIE 5.0 0110 in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where DeepSeek-R1 leads 44.5 to 39.8.

Side by side

DeepSeek-R1 and ERNIE 5.0 0110 specifications
DeepSeek-R1ERNIE 5.0 0110
ProviderDeepSeekBaidu
Noometry Index42.341.8
Released2025-01-20—
WeightsProprietaryProprietary
Context window164K—
Max output64K—
Input $ / M tokens$0.50—
Output $ / M tokens$2.15—
Results tracked5220

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding DeepSeek-R1 leads

DeepSeek-R1: 46.3 (#68), ERNIE 5.0 0110: 43.0 (#94)

Coding benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
LMArena Coding14271455
Aider Polyglot71.4%—
SciCode35.7%—
WeirdML41.6%—
LiveBench Coding66.7%—
ALE-Bench804.12—
AlgoTune1.7—

Agentic & Tool Use Not comparable

DeepSeek-R1: 30.7 (#75), ERNIE 5.0 0110: —

Agentic & Tool Use benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
DeepResearch Bench35.1%—
BALROG34.9%—
METR Time Horizons53.8%—

Reasoning DeepSeek-R1 leads

DeepSeek-R1: 18.6 (#278), ERNIE 5.0 0110: 17.0 (#297)

Reasoning benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
LMArena Hard Prompts14161445
ARC-AGI-21.3%—
SimpleBench40.8%—
Kagi LLM Benchmark69.4%—
NYT Connections (extended)—10.3%
ARC-AGI-121.2%—
CritPt1.1%—
Thematic Generalization—41.7%
LiveBench Reasoning83.2%—
LiveBench Data Analysis69.8%—
Epoch Capabilities Index141.29—
ForecastBench60—
LiveBench71.6%—

Math DeepSeek-R1 leads

DeepSeek-R1: 43.8 (#79), ERNIE 5.0 0110: 39.3 (#110)

Math benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
LMArena Math14001437
OTIS Mock AIME 2024-202566.4%—
Omni-MATH42.4%—
LiveBench Math80.7%—
MATH Level 596.6%—

Knowledge DeepSeek-R1 leads

DeepSeek-R1: 44.5 (#87), ERNIE 5.0 0110: 39.8 (#128)

Knowledge benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
LMArena Expert13941428
GPQA Diamond76.3%—
MMLU-Pro79.3%—
Confabulations12.7%—
Vectara Hallucination Rate11.3%—
GPQA (HELM)66.6%—

Multimodal Not comparable

DeepSeek-R1: —, ERNIE 5.0 0110: 39.9 (#53)

Multimodal benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
LMArena Vision—1249

Multilingual ERNIE 5.0 0110 leads

DeepSeek-R1: 52.4 (#85), ERNIE 5.0 0110: 54.1 (#49)

Multilingual benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
LMArena Non-English14121436
LMArena Chinese14421512
LMArena French14171467
LMArena German14041460
LMArena Japanese13911382
LMArena Korean13601406
LMArena Russian14231446
LMArena Spanish14111473

Instruction Following ERNIE 5.0 0110 leads

DeepSeek-R1: 72.0 (#143), ERNIE 5.0 0110: 74.5 (#92)

Instruction Following benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
LMArena Instruction Following13821413
LiveBench Instruction Following80.5%—
IFEval78.4%—

Long Context DeepSeek-R1 leads

DeepSeek-R1: 45.4 (#36), ERNIE 5.0 0110: 43.4 (#95)

Long Context benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
LMArena Longer Query13911422
Fiction.LiveBench75%—

Writing & Preference ERNIE 5.0 0110 leads

DeepSeek-R1: 61.4 (#88), ERNIE 5.0 0110: 63.1 (#66)

Writing & Preference benchmarks
BenchmarkDeepSeek-R1ERNIE 5.0 0110
LMArena Text14281445
LMArena Creative Writing14051426
LMArena Multi-Turn14051434
Short-Story Creative Writing83%—
EQ-Bench Creative Writing1500—
WildBench82.8%—
LiveBench Language48.5%—

Frequently asked questions

Is DeepSeek-R1 better than ERNIE 5.0 0110?

DeepSeek-R1 and ERNIE 5.0 0110 score almost the same on the Noometry Index (42.3 vs 41.8), so choose on price, context window or the category you care about most.

Is DeepSeek-R1 or ERNIE 5.0 0110 better for coding?

DeepSeek-R1 scores higher on coding benchmarks: 46.3 versus 43.0 in the Noometry coding category.

How many benchmarks do DeepSeek-R1 and ERNIE 5.0 0110 share?

17 benchmarks have published results for both models. DeepSeek-R1 has 52 scored results on Noometry and ERNIE 5.0 0110 has 20.

Related comparisons

Go deeper