Noometry

Model comparison

ERNIE 5.0 0110 vs Grok 4.1 Fast

ERNIE 5.0 0110 and Grok 4.1 Fast score almost the same on the Noometry Index (41.8 vs 41.4), so choose on price, context window or the category you care about most.

Last verified . 19 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Summary

  • They share 19 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 8 categories and Grok 4.1 Fast in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 43.4 to 17.0.
  • The biggest single-benchmark swing is NYT Connections (extended): 10.3% for ERNIE 5.0 0110 and 87.4% for Grok 4.1 Fast.

Side by side

ERNIE 5.0 0110Grok 4.1 Fast
ProviderBaiduxAI
Noometry Index41.841.4
Released—2025-06-27
WeightsProprietaryProprietary
Context window—128K
Max output—30K
Input $ / M tokens—$0.20
Output $ / M tokens—$0.50
Results tracked2032

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Grok 4.1 Fast: 34.1 (#245)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
LMArena Coding14551411
LMArena WebDev—1242
ALE-Bench—394.93

Agentic & Tool Use Not comparable

ERNIE 5.0 0110: —, Grok 4.1 Fast: 36.3 (#39)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
Berkeley Function Calling Leaderboard—69.6%
τ²-bench Banking—13.1%
LMArena Search—1171
Vending-Bench 2—1,107

Reasoning Grok 4.1 Fast leads

ERNIE 5.0 0110: 17.0 (#297), Grok 4.1 Fast: 43.4 (#49)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
NYT Connections (extended)10.3%87.4%
LMArena Hard Prompts14451407
SimpleBench—56%
Thematic Generalization41.7%—
DTBench—87.7%
ForecastBench—61

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Grok 4.1 Fast: 31.9 (#221)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
LMArena Math14371408
MathArena Final-Answer Competitions—60.9%
ProofBench—4%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Grok 4.1 Fast: 33.1 (#207)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
LMArena Expert14281399
Vectara Hallucination Rate—17.8%

Multimodal ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.9 (#53), Grok 4.1 Fast: 37.0 (#76)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
LMArena Vision12491201

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Grok 4.1 Fast: 51.0 (#114)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
LMArena Non-English14361391
LMArena Chinese15121441
LMArena French14671415
LMArena German14601404
LMArena Japanese13821349
LMArena Korean14061361
LMArena Russian14461387
LMArena Spanish14731413

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Grok 4.1 Fast: 72.7 (#133)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
LMArena Instruction Following14131376

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Grok 4.1 Fast: 42.4 (#126)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
LMArena Longer Query14221390

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Grok 4.1 Fast: 57.2 (#131)

BenchmarkERNIE 5.0 0110Grok 4.1 Fast
LMArena Text14451408
LMArena Creative Writing14261394
LMArena Multi-Turn14341389
EQ-Bench Creative Writing—1327

Frequently asked questions

Is ERNIE 5.0 0110 better than Grok 4.1 Fast?

ERNIE 5.0 0110 and Grok 4.1 Fast score almost the same on the Noometry Index (41.8 vs 41.4), so choose on price, context window or the category you care about most.

Is ERNIE 5.0 0110 or Grok 4.1 Fast better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 34.1 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Grok 4.1 Fast share?

19 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Grok 4.1 Fast has 32.

Related comparisons

Go deeper