Model comparison

ERNIE 5.1 vs Granite 4.2 8B

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 40.5 on the Noometry Index.

Last verified . 11 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Granite 4.2 8B IBM

40.5

Rank #148 Confirmed

Summary

  • They share 11 benchmarks with published results for both. ERNIE 5.1 scores higher in 6 categories and Granite 4.2 8B in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.1 leads 65.1 to 49.6.
  • Granite 4.2 8B has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.1 and Granite 4.2 8B specifications
ERNIE 5.1Granite 4.2 8B
ProviderBaiduIBM
Noometry Index43.840.5
Released——
WeightsProprietaryOpen
Context window—131K
Max output—118K
Input $ / M tokens—$0.06
Output $ / M tokens—$0.25
Results tracked1911

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.1 leads

ERNIE 5.1: 44.0 (#76), Granite 4.2 8B: 40.5 (#137)

Coding benchmarks
BenchmarkERNIE 5.1Granite 4.2 8B
LMArena Coding14881380

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Granite 4.2 8B: —

Agentic & Tool Use benchmarks
BenchmarkERNIE 5.1Granite 4.2 8B
LMArena Search1227—

Reasoning Granite 4.2 8B leads

ERNIE 5.1: 21.9 (#211), Granite 4.2 8B: 26.6 (#131)

Reasoning benchmarks
BenchmarkERNIE 5.1Granite 4.2 8B
LMArena Hard Prompts14811329
NYT Connections (extended)23.4%—

Math Not comparable

ERNIE 5.1: 40.3 (#92), Granite 4.2 8B: —

Math benchmarks
BenchmarkERNIE 5.1Granite 4.2 8B
LMArena Math1481—

Knowledge ERNIE 5.1 leads

ERNIE 5.1: 41.9 (#102), Granite 4.2 8B: 38.4 (#145)

Knowledge benchmarks
BenchmarkERNIE 5.1Granite 4.2 8B
LMArena Expert14921384

Multilingual ERNIE 5.1 leads

ERNIE 5.1: 55.5 (#29), Granite 4.2 8B: 44.5 (#178)

Multilingual benchmarks
BenchmarkERNIE 5.1Granite 4.2 8B
LMArena Non-English14541302
LMArena Chinese15081366
LMArena Russian14591285
LMArena French1488—
LMArena German1470—
LMArena Japanese1422—
LMArena Korean1427—
LMArena Spanish1473—

Instruction Following ERNIE 5.1 leads

ERNIE 5.1: 76.7 (#37), Granite 4.2 8B: 68.7 (#184)

Instruction Following benchmarks
BenchmarkERNIE 5.1Granite 4.2 8B
LMArena Instruction Following14601301

Long Context ERNIE 5.1 leads

ERNIE 5.1: 44.7 (#59), Granite 4.2 8B: 40.3 (#159)

Long Context benchmarks
BenchmarkERNIE 5.1Granite 4.2 8B
LMArena Longer Query14621324

Writing & Preference ERNIE 5.1 leads

ERNIE 5.1: 65.1 (#52), Granite 4.2 8B: 49.6 (#189)

Writing & Preference benchmarks
BenchmarkERNIE 5.1Granite 4.2 8B
LMArena Text14681320
LMArena Creative Writing14411236
LMArena Multi-Turn14711301

Frequently asked questions

Is ERNIE 5.1 better than Granite 4.2 8B?

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 40.5 on the Noometry Index.

Is ERNIE 5.1 or Granite 4.2 8B better for coding?

ERNIE 5.1 scores higher on coding benchmarks: 44.0 versus 40.5 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Granite 4.2 8B share?

11 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Granite 4.2 8B has 11.

Related comparisons

Go deeper