Noometry

Model comparison

ERNIE 5.0 0110 vs Granite 4.1 8b

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 37.4 on the Noometry Index.

Last verified . 12 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Granite 4.1 8b IBM

37.4

Rank #205 Confirmed

Summary

  • They share 12 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 7 categories and Granite 4.1 8b in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 48.1.
  • Granite 4.1 8b has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110Granite 4.1 8b
ProviderBaiduIBM
Noometry Index41.837.4
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2013

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Granite 4.1 8b: 30.1 (#297)

BenchmarkERNIE 5.0 0110Granite 4.1 8b
LMArena Coding14551312
LMArena WebDev—1192

Reasoning Granite 4.1 8b leads

ERNIE 5.0 0110: 17.0 (#297), Granite 4.1 8b: 25.7 (#143)

BenchmarkERNIE 5.0 0110Granite 4.1 8b
LMArena Hard Prompts14451293
NYT Connections (extended)10.3%—
Thematic Generalization41.7%—

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Granite 4.1 8b: 36.4 (#166)

BenchmarkERNIE 5.0 0110Granite 4.1 8b
LMArena Math14371312

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Granite 4.1 8b: 36.1 (#174)

BenchmarkERNIE 5.0 0110Granite 4.1 8b
LMArena Expert14281309

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Granite 4.1 8b: —

BenchmarkERNIE 5.0 0110Granite 4.1 8b
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Granite 4.1 8b: 41.7 (#204)

BenchmarkERNIE 5.0 0110Granite 4.1 8b
LMArena Non-English14361261
LMArena Chinese15121337
LMArena Russian14461240
LMArena French1467—
LMArena German1460—
LMArena Japanese1382—
LMArena Korean1406—
LMArena Spanish1473—

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Granite 4.1 8b: 66.9 (#203)

BenchmarkERNIE 5.0 0110Granite 4.1 8b
LMArena Instruction Following14131269

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Granite 4.1 8b: 38.7 (#193)

BenchmarkERNIE 5.0 0110Granite 4.1 8b
LMArena Longer Query14221275

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Granite 4.1 8b: 48.1 (#204)

BenchmarkERNIE 5.0 0110Granite 4.1 8b
LMArena Text14451290
LMArena Creative Writing14261251
LMArena Multi-Turn14341268

Frequently asked questions

Is ERNIE 5.0 0110 better than Granite 4.1 8b?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 37.4 on the Noometry Index.

Is ERNIE 5.0 0110 or Granite 4.1 8b better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 30.1 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Granite 4.1 8b share?

12 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Granite 4.1 8b has 13.

Related comparisons

Go deeper