Noometry

Model comparison

Claude Opus 4.1 vs ERNIE 5.1

ERNIE 5.1 is the stronger model overall, scoring 43.1 to 40.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

Claude Opus 4.1 Anthropic

40.8

Rank #136 Confirmed

ERNIE 5.1 Baidu

43.1

Rank #87 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Claude Opus 4.1 scores higher in 3 categories and ERNIE 5.1 in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where ERNIE 5.1 leads 37.5 to 22.0.

Side by side

Claude Opus 4.1ERNIE 5.1
ProviderAnthropicBaidu
Noometry Index40.843.1
Released2025-08-05—
WeightsProprietaryProprietary
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked4819

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Claude Opus 4.1: 44.3 (#69), ERNIE 5.1: 43.4 (#78)

BenchmarkClaude Opus 4.1ERNIE 5.1
LMArena Coding14791488
SWE-bench Verified73.3%—
LMArena WebDev1390—
WeirdML45.9%—
ALE-Bench674.77—
AlgoTune1.34—

Agentic & Tool Use Not comparable

Claude Opus 4.1: 34.8 (#38), ERNIE 5.1: —

BenchmarkClaude Opus 4.1ERNIE 5.1
LMArena Search11481227
Terminal-Bench38%—
GDPval43.6%—
Cybench42%—
DeepResearch Bench48.3%—
METR Time Horizons66.8%—

Reasoning Claude Opus 4.1 leads

Claude Opus 4.1: 31.6 (#70), ERNIE 5.1: 20.9 (#209)

BenchmarkClaude Opus 4.1ERNIE 5.1
LMArena Hard Prompts14431481
SimpleBench60%—
NYT Connections (extended)—23.4%
Chess Puzzles7%—
EnigmaEval7.2%—
EBR-Bench7.9%—
Mystery Game Puzzles21%—
DTBench80%—
LMCA37.1%—
Epoch Capabilities Index144.11—
ForecastBench62—

Math ERNIE 5.1 leads

Claude Opus 4.1: 22.0 (#267), ERNIE 5.1: 37.5 (#96)

BenchmarkClaude Opus 4.1ERNIE 5.1
LMArena Math14301481
FrontierMath (Tiers 1-3)12.6%—
FrontierMath Tier 42.4%—
OTIS Mock AIME 2024-202568.9%—
FrontierMath (Feb 2025 set)7.2%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Too close to call

Claude Opus 4.1: 41.9 (#93), ERNIE 5.1: 41.2 (#103)

BenchmarkClaude Opus 4.1ERNIE 5.1
LMArena Expert14391491
GPQA Diamond77.3%—
Humanity's Last Exam11.5%—
Confabulations17.1%—
Vectara Hallucination Rate11.8%—

Multimodal Not comparable

Claude Opus 4.1: 26.2 (#114), ERNIE 5.1: —

BenchmarkClaude Opus 4.1ERNIE 5.1
VPCT35%—

Multilingual ERNIE 5.1 leads

Claude Opus 4.1: 52.1 (#90), ERNIE 5.1: 55.7 (#28)

BenchmarkClaude Opus 4.1ERNIE 5.1
LMArena Non-English14051455
LMArena Chinese14271507
LMArena French14321486
LMArena German14121470
LMArena Japanese13781422
LMArena Korean13811428
LMArena Russian14211459
LMArena Spanish14481472

Instruction Following ERNIE 5.1 leads

Claude Opus 4.1: 75.8 (#53), ERNIE 5.1: 76.9 (#35)

BenchmarkClaude Opus 4.1ERNIE 5.1
LMArena Instruction Following14361460

Long Context Too close to call

Claude Opus 4.1: 44.5 (#60), ERNIE 5.1: 44.7 (#56)

BenchmarkClaude Opus 4.1ERNIE 5.1
LMArena Longer Query14551462

Writing & Preference ERNIE 5.1 leads

Claude Opus 4.1: 62.6 (#70), ERNIE 5.1: 65.3 (#50)

BenchmarkClaude Opus 4.1ERNIE 5.1
LMArena Text14191468
LMArena Creative Writing14121440
LMArena Multi-Turn14441471
Short-Story Creative Writing84.7%—

Frequently asked questions

Is Claude Opus 4.1 better than ERNIE 5.1?

ERNIE 5.1 is the stronger model overall, scoring 43.1 to 40.8 on the Noometry Index.

Is Claude Opus 4.1 or ERNIE 5.1 better for coding?

They score almost the same on coding (44.3 vs 43.4); test both on your own repository before choosing.

How many benchmarks do Claude Opus 4.1 and ERNIE 5.1 share?

18 benchmarks have published results for both models. Claude Opus 4.1 has 48 scored results on Noometry and ERNIE 5.1 has 19.

Related comparisons

Go deeper