Model comparison

Amazon Nova Experimental Chat 10 20 vs ERNIE 5.0 0110

Amazon Nova Experimental Chat 10 20 and ERNIE 5.0 0110 score almost the same on the Noometry Index (42.1 vs 41.8), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Experimental Chat 10 20 scores higher in 1 category and ERNIE 5.0 0110 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Amazon Nova Experimental Chat 10 20 leads 28.4 to 17.0.

Side by side

Amazon Nova Experimental Chat 10 20 and ERNIE 5.0 0110 specifications
Amazon Nova Experimental Chat 10 20ERNIE 5.0 0110
ProviderAmazonBaidu
Noometry Index42.141.8
Released——
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1720

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

Amazon Nova Experimental Chat 10 20: 41.6 (#123), ERNIE 5.0 0110: 43.0 (#94)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20ERNIE 5.0 0110
LMArena Coding14121455

Reasoning Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 28.4 (#106), ERNIE 5.0 0110: 17.0 (#297)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20ERNIE 5.0 0110
LMArena Hard Prompts13961445
NYT Connections (extended)—10.3%
Thematic Generalization—41.7%

Math Too close to call

Amazon Nova Experimental Chat 10 20: 39.0 (#119), ERNIE 5.0 0110: 39.3 (#110)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20ERNIE 5.0 0110
LMArena Math14251437

Knowledge ERNIE 5.0 0110 leads

Amazon Nova Experimental Chat 10 20: 38.5 (#144), ERNIE 5.0 0110: 39.8 (#128)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20ERNIE 5.0 0110
LMArena Expert13861428

Multimodal Not comparable

Amazon Nova Experimental Chat 10 20: —, ERNIE 5.0 0110: 39.9 (#53)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20ERNIE 5.0 0110
LMArena Vision—1249

Multilingual ERNIE 5.0 0110 leads

Amazon Nova Experimental Chat 10 20: 49.5 (#131), ERNIE 5.0 0110: 54.1 (#49)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20ERNIE 5.0 0110
LMArena Non-English13721436
LMArena Chinese14041512
LMArena French14251467
LMArena German13911460
LMArena Japanese13601382
LMArena Korean13241406
LMArena Russian13711446
LMArena Spanish13821473

Instruction Following ERNIE 5.0 0110 leads

Amazon Nova Experimental Chat 10 20: 72.1 (#141), ERNIE 5.0 0110: 74.5 (#92)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20ERNIE 5.0 0110
LMArena Instruction Following13651413

Long Context ERNIE 5.0 0110 leads

Amazon Nova Experimental Chat 10 20: 41.7 (#133), ERNIE 5.0 0110: 43.4 (#95)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20ERNIE 5.0 0110
LMArena Longer Query13701422

Writing & Preference ERNIE 5.0 0110 leads

Amazon Nova Experimental Chat 10 20: 56.6 (#136), ERNIE 5.0 0110: 63.1 (#66)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20ERNIE 5.0 0110
LMArena Text13941445
LMArena Creative Writing13181426
LMArena Multi-Turn13641434

Frequently asked questions

Is Amazon Nova Experimental Chat 10 20 better than ERNIE 5.0 0110?

Amazon Nova Experimental Chat 10 20 and ERNIE 5.0 0110 score almost the same on the Noometry Index (42.1 vs 41.8), so choose on price, context window or the category you care about most.

Is Amazon Nova Experimental Chat 10 20 or ERNIE 5.0 0110 better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 41.6 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 20 and ERNIE 5.0 0110 share?

17 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 20 has 17 scored results on Noometry and ERNIE 5.0 0110 has 20.

Related comparisons

Go deeper