Model comparison

ERNIE 5.0 0110 vs Llama 3.2 90B

ERNIE 5.0 0110 is the stronger model overall, scoring 41.2 to 27.1 on the Noometry Index.

Last verified . 1 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.2

Rank #129 Confirmed

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Summary

  • They share 1 benchmark with published results for both. ERNIE 5.0 0110 scores higher in 3 categories and Llama 3.2 90B in 1 category; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where ERNIE 5.0 0110 leads 36.5 to 10.4.
  • Llama 3.2 90B has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110 and Llama 3.2 90B specifications
ERNIE 5.0 0110Llama 3.2 90B
ProviderBaiduMeta
Noometry Index41.227.1
Released—2024-09-24
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked209

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

ERNIE 5.0 0110: 42.3 (#94), Llama 3.2 90B: —

Coding benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
LMArena Coding1455—

Agentic & Tool Use Not comparable

ERNIE 5.0 0110: —, Llama 3.2 90B: 29.7 (#73)

Agentic & Tool Use benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
BALROG—27.3%

Reasoning Llama 3.2 90B leads

ERNIE 5.0 0110: 16.3 (#296), Llama 3.2 90B: 20.9 (#207)

Reasoning benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
NYT Connections (extended)10.3%—
EnigmaEval—0.4%
Thematic Generalization41.7%—
LMArena Hard Prompts1446—
Epoch Capabilities Index—125.5

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 36.5 (#111), Llama 3.2 90B: 10.4 (#302)

Math benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
OTIS Mock AIME 2024-2025—2.6%
LMArena Math1437—
MATH Level 5—39.4%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.2 (#125), Llama 3.2 90B: 21.7 (#269)

Knowledge benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
GPQA Diamond—41%
LMArena Expert1427—
MMLU—80.3%

Multimodal ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.1 (#49), Llama 3.2 90B: 24.9 (#119)

Multimodal benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
LMArena Vision12481000
GeoBench—52%

Multilingual Not comparable

ERNIE 5.0 0110: 54.3 (#47), Llama 3.2 90B: —

Multilingual benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
LMArena Non-English1436—
LMArena Chinese1512—
LMArena French1466—
LMArena German1462—
LMArena Japanese1383—
LMArena Korean1406—
LMArena Russian1446—
LMArena Spanish1473—

Instruction Following Not comparable

ERNIE 5.0 0110: 74.7 (#88), Llama 3.2 90B: —

Instruction Following benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
LMArena Instruction Following1413—

Long Context Not comparable

ERNIE 5.0 0110: 43.4 (#90), Llama 3.2 90B: —

Long Context benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
LMArena Longer Query1422—

Writing & Preference Not comparable

ERNIE 5.0 0110: 63.4 (#64), Llama 3.2 90B: —

Writing & Preference benchmarks
BenchmarkERNIE 5.0 0110Llama 3.2 90B
LMArena Text1445—
LMArena Creative Writing1426—
LMArena Multi-Turn1433—

Frequently asked questions

Is ERNIE 5.0 0110 better than Llama 3.2 90B?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.2 to 27.1 on the Noometry Index.

How many benchmarks do ERNIE 5.0 0110 and Llama 3.2 90B share?

1 benchmark has published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Llama 3.2 90B has 9.

Related comparisons

Go deeper