Noometry

Model comparison

ERNIE 5.0 0110 vs Grok-2 (Dec 2024)

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 33.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Grok-2 (Dec 2024) xAI

33.7

Rank #239 Confirmed

Summary

  • They share 17 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 8 categories and Grok-2 (Dec 2024) in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where ERNIE 5.0 0110 leads 39.3 to 20.8.

Side by side

ERNIE 5.0 0110Grok-2 (Dec 2024)
ProviderBaiduxAI
Noometry Index41.833.7
Released—2024-08-13
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2034

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Grok-2 (Dec 2024): 33.3 (#258)

BenchmarkERNIE 5.0 0110Grok-2 (Dec 2024)
LMArena Coding14551287
WeirdML—22.2%
LiveBench Coding—46.4%

Reasoning Too close to call

ERNIE 5.0 0110: 17.0 (#297), Grok-2 (Dec 2024): 16.9 (#299)

BenchmarkERNIE 5.0 0110Grok-2 (Dec 2024)
LMArena Hard Prompts14451272
SimpleBench—22.7%
NYT Connections (extended)10.3%—
Thematic Generalization41.7%—
LiveBench Reasoning—54.8%
DTBench—65.2%
LiveBench Data Analysis—54.5%
Epoch Capabilities Index—130.48
LiveBench—54.3%

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Grok-2 (Dec 2024): 20.8 (#284)

BenchmarkERNIE 5.0 0110Grok-2 (Dec 2024)
LMArena Math14371283
OTIS Mock AIME 2024-2025—11.5%
LiveBench Math—54.9%
MATH Level 5—63.5%
FrontierMath (Feb 2025 set)—0.7%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Grok-2 (Dec 2024): 29.8 (#233)

BenchmarkERNIE 5.0 0110Grok-2 (Dec 2024)
LMArena Expert14281254
GPQA Diamond—53.8%
Confabulations—20.1%

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Grok-2 (Dec 2024): —

BenchmarkERNIE 5.0 0110Grok-2 (Dec 2024)
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Grok-2 (Dec 2024): 43.1 (#188)

BenchmarkERNIE 5.0 0110Grok-2 (Dec 2024)
LMArena Non-English14361282
LMArena Chinese15121289
LMArena French14671318
LMArena German14601287
LMArena Japanese13821244
LMArena Korean14061237
LMArena Russian14461286
LMArena Spanish14731281

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Grok-2 (Dec 2024): 66.9 (#202)

BenchmarkERNIE 5.0 0110Grok-2 (Dec 2024)
LMArena Instruction Following14131270
LiveBench Instruction Following—69.6%

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Grok-2 (Dec 2024): 38.8 (#190)

BenchmarkERNIE 5.0 0110Grok-2 (Dec 2024)
LMArena Longer Query14221276

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Grok-2 (Dec 2024): 48.6 (#198)

BenchmarkERNIE 5.0 0110Grok-2 (Dec 2024)
LMArena Text14451305
LMArena Creative Writing14261284
LMArena Multi-Turn14341290
Short-Story Creative Writing—63.6%
LiveBench Language—45.6%

Frequently asked questions

Is ERNIE 5.0 0110 better than Grok-2 (Dec 2024)?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 33.7 on the Noometry Index.

Is ERNIE 5.0 0110 or Grok-2 (Dec 2024) better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 33.3 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Grok-2 (Dec 2024) share?

17 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Grok-2 (Dec 2024) has 34.

Related comparisons

Go deeper