Noometry

Model comparison

Claude Sonnet 5 vs ERNIE 5.1

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 43.8 on the Noometry Index.

Last verified . 19 shared benchmarks.

Claude Sonnet 5 Anthropic

54.6

Rank #29 Confirmed

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Claude Sonnet 5 scores higher in 6 categories and ERNIE 5.1 in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Sonnet 5 leads 49.1 to 21.9.
  • The biggest single-benchmark swing is NYT Connections (extended): 75.1% for Claude Sonnet 5 and 23.4% for ERNIE 5.1.

Side by side

Claude Sonnet 5ERNIE 5.1
ProviderAnthropicBaidu
Noometry Index54.643.8
Released2026-06-29—
WeightsProprietaryProprietary
Context window1M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$10—
Results tracked5119

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5 leads

Claude Sonnet 5: 55.5 (#26), ERNIE 5.1: 44.0 (#76)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Coding14831488
DeepSWE53.8%—
FrontierCode42.7%—
CursorBench34.1%—
LMArena WebDev1541—
SciCode54.3%—
GSO37.3%—
WeirdML68.8%—
ALE-Bench1,463—

Agentic & Tool Use Not comparable

Claude Sonnet 5: 42.8 (#18), ERNIE 5.1: —

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Search11941227
APEX-Agents54.5%—
GBAEval65.3%—
Vending-Bench 26,378—

Reasoning Claude Sonnet 5 leads

Claude Sonnet 5: 49.1 (#39), ERNIE 5.1: 21.9 (#211)

BenchmarkClaude Sonnet 5ERNIE 5.1
NYT Connections (extended)75.1%23.4%
LMArena Hard Prompts14611481
SimpleBench60.6%—
CritPt16.9%—
Chess Puzzles35%—
Mystery Game Puzzles35%—
DTBench92.5%—
LMCA50%—
Surface Evolver Bench60%—
Bench to the Future 30.14—
Epoch Capabilities Index156.21—
ForecastBench61.1—

Math Claude Sonnet 5 leads

Claude Sonnet 5: 66.2 (#27), ERNIE 5.1: 40.3 (#92)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Math14671481
FrontierMath (Tiers 1-3)65.6%—
FrontierMath Tier 429.3%—
OTIS Mock AIME 2024-202594.7%—
ProofBench77%—

Knowledge Claude Sonnet 5 leads

Claude Sonnet 5: 55.6 (#47), ERNIE 5.1: 41.9 (#102)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Expert14901492
GPQA Diamond90.5%—
SimpleQA Verified33.7%—

Multimodal Not comparable

Claude Sonnet 5: 42.4 (#31), ERNIE 5.1: —

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Vision1274—
Blueprint-Bench 224.9%—
LMArena Document1466—

Multilingual ERNIE 5.1 leads

Claude Sonnet 5: 53.8 (#55), ERNIE 5.1: 55.5 (#29)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Non-English14311454
LMArena Chinese14771508
LMArena French14601488
LMArena German14401470
LMArena Japanese14221422
LMArena Korean14111427
LMArena Russian14511459
LMArena Spanish14371473

Instruction Following Too close to call

Claude Sonnet 5: 76.3 (#41), ERNIE 5.1: 76.7 (#37)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Instruction Following14521460

Long Context Too close to call

Claude Sonnet 5: 44.8 (#55), ERNIE 5.1: 44.7 (#59)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Longer Query14631462

Writing & Preference Claude Sonnet 5 leads

Claude Sonnet 5: 69.2 (#25), ERNIE 5.1: 65.1 (#52)

BenchmarkClaude Sonnet 5ERNIE 5.1
LMArena Text14421468
LMArena Creative Writing14161441
LMArena Multi-Turn14541471
EQ-Bench Creative Writing1794—
EQ-Bench 41236—

Frequently asked questions

Is Claude Sonnet 5 better than ERNIE 5.1?

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 43.8 on the Noometry Index.

Is Claude Sonnet 5 or ERNIE 5.1 better for coding?

Claude Sonnet 5 scores higher on coding benchmarks: 55.5 versus 44.0 in the Noometry coding category.

How many benchmarks do Claude Sonnet 5 and ERNIE 5.1 share?

19 benchmarks have published results for both models. Claude Sonnet 5 has 51 scored results on Noometry and ERNIE 5.1 has 19.

Related comparisons

Go deeper