Model comparison

ERNIE 5.0 0110 vs Granite 4.0 H Small

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 36.5 on the Noometry Index.

Last verified . 13 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Summary

  • They share 13 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 7 categories and Granite 4.0 H Small in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 43.8.
  • Granite 4.0 H Small has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110 and Granite 4.0 H Small specifications
ERNIE 5.0 0110Granite 4.0 H Small
ProviderBaiduIBM
Noometry Index41.836.5
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2019

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Granite 4.0 H Small: 36.4 (#209)

Coding benchmarks
BenchmarkERNIE 5.0 0110Granite 4.0 H Small
LMArena Coding14551249

Reasoning Granite 4.0 H Small leads

ERNIE 5.0 0110: 17.0 (#297), Granite 4.0 H Small: 24.4 (#163)

Reasoning benchmarks
BenchmarkERNIE 5.0 0110Granite 4.0 H Small
LMArena Hard Prompts14451240
NYT Connections (extended)10.3%—
Thematic Generalization41.7%—

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Granite 4.0 H Small: 31.4 (#223)

Math benchmarks
BenchmarkERNIE 5.0 0110Granite 4.0 H Small
LMArena Math14371247
Omni-MATH—29.6%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Granite 4.0 H Small: 32.0 (#215)

Knowledge benchmarks
BenchmarkERNIE 5.0 0110Granite 4.0 H Small
LMArena Expert14281251
MMLU-Pro—56.9%
Vectara Hallucination Rate—5.2%
GPQA (HELM)—38.3%

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Granite 4.0 H Small: —

Multimodal benchmarks
BenchmarkERNIE 5.0 0110Granite 4.0 H Small
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Granite 4.0 H Small: 38.6 (#228)

Multilingual benchmarks
BenchmarkERNIE 5.0 0110Granite 4.0 H Small
LMArena Non-English14361216
LMArena Chinese15121249
LMArena Russian14461201
LMArena Spanish14731258
LMArena French1467—
LMArena German1460—
LMArena Japanese1382—
LMArena Korean1406—

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Granite 4.0 H Small: 68.7 (#183)

Instruction Following benchmarks
BenchmarkERNIE 5.0 0110Granite 4.0 H Small
LMArena Instruction Following14131222
IFEval—89%

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Granite 4.0 H Small: 37.7 (#213)

Long Context benchmarks
BenchmarkERNIE 5.0 0110Granite 4.0 H Small
LMArena Longer Query14221242

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Granite 4.0 H Small: 43.8 (#227)

Writing & Preference benchmarks
BenchmarkERNIE 5.0 0110Granite 4.0 H Small
LMArena Text14451241
LMArena Creative Writing14261211
LMArena Multi-Turn14341242
WildBench—73.9%

Frequently asked questions

Is ERNIE 5.0 0110 better than Granite 4.0 H Small?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 36.5 on the Noometry Index.

Is ERNIE 5.0 0110 or Granite 4.0 H Small better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 36.4 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Granite 4.0 H Small share?

13 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Granite 4.0 H Small has 19.

Related comparisons

Go deeper