Model comparison

Amazon Nova Pro vs ERNIE 5.0 0110

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 31.0 on the Noometry Index.

Last verified . 18 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Amazon Nova Pro scores higher in 1 category and ERNIE 5.0 0110 in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 43.9.

Side by side

Amazon Nova Pro and ERNIE 5.0 0110 specifications
Amazon Nova ProERNIE 5.0 0110
ProviderAmazonBaidu
Noometry Index31.041.8
Released2024-12-03—
WeightsProprietaryProprietary
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3820

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

Amazon Nova Pro: 35.1 (#229), ERNIE 5.0 0110: 43.0 (#94)

Coding benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
LMArena Coding12701455
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), ERNIE 5.0 0110: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Amazon Nova Pro leads

Amazon Nova Pro: 20.0 (#243), ERNIE 5.0 0110: 17.0 (#297)

Reasoning benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
LMArena Hard Prompts12461445
NYT Connections (extended)—10.3%
Thematic Generalization—41.7%
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math ERNIE 5.0 0110 leads

Amazon Nova Pro: 28.5 (#243), ERNIE 5.0 0110: 39.3 (#110)

Math benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
LMArena Math12521437
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge ERNIE 5.0 0110 leads

Amazon Nova Pro: 27.4 (#250), ERNIE 5.0 0110: 39.8 (#128)

Knowledge benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
LMArena Expert12111428
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal ERNIE 5.0 0110 leads

Amazon Nova Pro: 25.0 (#126), ERNIE 5.0 0110: 39.9 (#53)

Multimodal benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
LMArena Vision9801249

Multilingual ERNIE 5.0 0110 leads

Amazon Nova Pro: 39.7 (#223), ERNIE 5.0 0110: 54.1 (#49)

Multilingual benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
LMArena Non-English12341436
LMArena Chinese12441512
LMArena French12711467
LMArena German12431460
LMArena Japanese12001382
LMArena Korean12031406
LMArena Russian12401446
LMArena Spanish11821473

Instruction Following ERNIE 5.0 0110 leads

Amazon Nova Pro: 64.9 (#226), ERNIE 5.0 0110: 74.5 (#92)

Instruction Following benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
LMArena Instruction Following12351413
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context ERNIE 5.0 0110 leads

Amazon Nova Pro: 38.1 (#205), ERNIE 5.0 0110: 43.4 (#95)

Long Context benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
LMArena Longer Query12551422

Writing & Preference ERNIE 5.0 0110 leads

Amazon Nova Pro: 43.9 (#226), ERNIE 5.0 0110: 63.1 (#66)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProERNIE 5.0 0110
LMArena Text12591445
LMArena Creative Writing12121426
LMArena Multi-Turn12461434
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than ERNIE 5.0 0110?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 31.0 on the Noometry Index.

Is Amazon Nova Pro or ERNIE 5.0 0110 better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 35.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Pro and ERNIE 5.0 0110 share?

18 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and ERNIE 5.0 0110 has 20.

Related comparisons

Go deeper