Noometry

Model comparison

Claude Sonnet 5.5 vs ERNIE 5.1

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 43.8 on the Noometry Index.

Last verified . 13 shared benchmarks.

Claude Sonnet 5.5 Anthropic

61.9

Rank #10 Confirmed

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Claude Sonnet 5.5 scores higher in 7 categories and ERNIE 5.1 in 1 category; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5.5 leads 87.9 to 40.3.
  • The biggest single-benchmark swing is NYT Connections (extended): 80.5% for Claude Sonnet 5.5 and 23.4% for ERNIE 5.1.

Side by side

Claude Sonnet 5.5ERNIE 5.1
ProviderAnthropicBaidu
Noometry Index61.943.8
Released2026-09-28—
WeightsProprietaryProprietary
Context window1M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$10—
Results tracked3219

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 67.3 (#6), ERNIE 5.1: 44.0 (#76)

BenchmarkClaude Sonnet 5.5ERNIE 5.1
LMArena Coding15131488
FrontierCode52.1%—
CursorBench55.5%—
LMArena WebDev1774—
FrontierSWE61.9%—
SciCode61%—
ALE-Bench1,819—

Agentic & Tool Use Not comparable

Claude Sonnet 5.5: 45.0 (#16), ERNIE 5.1: —

BenchmarkClaude Sonnet 5.5ERNIE 5.1
APEX-Agents75.5%—
LMArena Search—1227

Reasoning Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 54.0 (#28), ERNIE 5.1: 21.9 (#211)

BenchmarkClaude Sonnet 5.5ERNIE 5.1
NYT Connections (extended)80.5%23.4%
LMArena Hard Prompts14951481
CritPt31.4%—
Mystery Game Puzzles65%—
Epoch Capabilities Index165.03—

Math Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 87.9 (#6), ERNIE 5.1: 40.3 (#92)

BenchmarkClaude Sonnet 5.5ERNIE 5.1
LMArena Math15101481
FrontierMath (Tiers 1-3)88.8%—
FrontierMath Tier 480.5%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
FrontierMath Erdős2.9%—

Knowledge Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#12), ERNIE 5.1: 41.9 (#102)

BenchmarkClaude Sonnet 5.5ERNIE 5.1
LMArena Expert15401492
GPQA Diamond95.6%—
SimpleQA Verified46.5%—

Multimodal Not comparable

Claude Sonnet 5.5: 51.5 (#6), ERNIE 5.1: —

BenchmarkClaude Sonnet 5.5ERNIE 5.1
LMArena Vision1289—
Furniture Assembly75%—

Multilingual Too close to call

Claude Sonnet 5.5: 55.3 (#30), ERNIE 5.1: 55.5 (#29)

BenchmarkClaude Sonnet 5.5ERNIE 5.1
LMArena Non-English14521454
LMArena Chinese15221508
LMArena Russian14511459
LMArena French—1488
LMArena German—1470
LMArena Japanese—1422
LMArena Korean—1427
LMArena Spanish—1473

Instruction Following Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 78.3 (#11), ERNIE 5.1: 76.7 (#37)

BenchmarkClaude Sonnet 5.5ERNIE 5.1
LMArena Instruction Following14951460

Long Context Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 45.9 (#28), ERNIE 5.1: 44.7 (#59)

BenchmarkClaude Sonnet 5.5ERNIE 5.1
LMArena Longer Query14981462

Writing & Preference Too close to call

Claude Sonnet 5.5: 66.0 (#40), ERNIE 5.1: 65.1 (#52)

BenchmarkClaude Sonnet 5.5ERNIE 5.1
LMArena Text14711468
LMArena Creative Writing14651441
LMArena Multi-Turn14741471

Frequently asked questions

Is Claude Sonnet 5.5 better than ERNIE 5.1?

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 43.8 on the Noometry Index.

Is Claude Sonnet 5.5 or ERNIE 5.1 better for coding?

Claude Sonnet 5.5 scores higher on coding benchmarks: 67.3 versus 44.0 in the Noometry coding category.

How many benchmarks do Claude Sonnet 5.5 and ERNIE 5.1 share?

13 benchmarks have published results for both models. Claude Sonnet 5.5 has 32 scored results on Noometry and ERNIE 5.1 has 19.

Related comparisons

Go deeper