Model comparison

Claude Instant vs ERNIE 5.0 0110

ERNIE 5.0 0110 has enough public results to be ranked (#129); Claude Instant does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Claude Instant Anthropic

29.5

Unranked Sparse

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Side by side

Claude Instant and ERNIE 5.0 0110 specifications
Claude InstantERNIE 5.0 0110
ProviderAnthropicBaidu
Noometry Index29.541.8
Released2023-08-09—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked720

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Instant: —, ERNIE 5.0 0110: 43.0 (#94)

Coding benchmarks
BenchmarkClaude InstantERNIE 5.0 0110
LMArena Coding—1455
HumanEval+50.6%—

Reasoning Claude Instant leads

Claude Instant: 19.6, ERNIE 5.0 0110: 17.0 (#297)

Reasoning benchmarks
BenchmarkClaude InstantERNIE 5.0 0110
NYT Connections (extended)—10.3%
Thematic Generalization—41.7%
LMArena Hard Prompts—1445
DTBench45.8%—
Epoch Capabilities Index120.28—

Math Not comparable

Claude Instant: —, ERNIE 5.0 0110: 39.3 (#110)

Math benchmarks
BenchmarkClaude InstantERNIE 5.0 0110
LMArena Math—1437
GSM8K86.7%—

Knowledge Not comparable

Claude Instant: —, ERNIE 5.0 0110: 39.8 (#128)

Knowledge benchmarks
BenchmarkClaude InstantERNIE 5.0 0110
LMArena Expert—1428
ARC (AI2) Challenge86.3%—
MMLU73.4%—
TriviaQA78.9%—

Multimodal Not comparable

Claude Instant: —, ERNIE 5.0 0110: 39.9 (#53)

Multimodal benchmarks
BenchmarkClaude InstantERNIE 5.0 0110
LMArena Vision—1249

Multilingual Not comparable

Claude Instant: —, ERNIE 5.0 0110: 54.1 (#49)

Multilingual benchmarks
BenchmarkClaude InstantERNIE 5.0 0110
LMArena Non-English—1436
LMArena Chinese—1512
LMArena French—1467
LMArena German—1460
LMArena Japanese—1382
LMArena Korean—1406
LMArena Russian—1446
LMArena Spanish—1473

Instruction Following Not comparable

Claude Instant: —, ERNIE 5.0 0110: 74.5 (#92)

Instruction Following benchmarks
BenchmarkClaude InstantERNIE 5.0 0110
LMArena Instruction Following—1413

Long Context Not comparable

Claude Instant: —, ERNIE 5.0 0110: 43.4 (#95)

Long Context benchmarks
BenchmarkClaude InstantERNIE 5.0 0110
LMArena Longer Query—1422

Writing & Preference Not comparable

Claude Instant: —, ERNIE 5.0 0110: 63.1 (#66)

Writing & Preference benchmarks
BenchmarkClaude InstantERNIE 5.0 0110
LMArena Text—1445
LMArena Creative Writing—1426
LMArena Multi-Turn—1434

Frequently asked questions

Is Claude Instant better than ERNIE 5.0 0110?

ERNIE 5.0 0110 has enough public results to be ranked (#129); Claude Instant does not yet, so treat this comparison as directional.

How many benchmarks do Claude Instant and ERNIE 5.0 0110 share?

0 benchmarks have published results for both models. Claude Instant has 7 scored results on Noometry and ERNIE 5.0 0110 has 20.

Related comparisons

Go deeper