Model comparison

ERNIE 5.0 0110 vs Longcat Flash Chat

ERNIE 5.0 0110 and Longcat Flash Chat score almost the same on the Noometry Index (41.8 vs 42.1), so choose on price, context window or the category you care about most.

Last verified . 18 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Longcat Flash Chat Meituan

42.1

Rank #120 Confirmed

Summary

  • They share 18 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 3 categories and Longcat Flash Chat in 5 categories; 3 gaps are clear of the uncertainty.
  • The biggest single-benchmark swing is NYT Connections (extended): 10.3% for ERNIE 5.0 0110 and 17.7% for Longcat Flash Chat.
  • Longcat Flash Chat has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110 and Longcat Flash Chat specifications
ERNIE 5.0 0110Longcat Flash Chat
ProviderBaiduMeituan
Noometry Index41.842.1
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2019

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

ERNIE 5.0 0110: 43.0 (#94), Longcat Flash Chat: 43.5 (#87)

Coding benchmarks
BenchmarkERNIE 5.0 0110Longcat Flash Chat
LMArena Coding14551471

Reasoning Longcat Flash Chat leads

ERNIE 5.0 0110: 17.0 (#297), Longcat Flash Chat: 19.0 (#272)

Reasoning benchmarks
BenchmarkERNIE 5.0 0110Longcat Flash Chat
NYT Connections (extended)10.3%17.7%
LMArena Hard Prompts14451440
Kagi LLM Benchmark—43.9%
Thematic Generalization41.7%—

Math Too close to call

ERNIE 5.0 0110: 39.3 (#110), Longcat Flash Chat: 39.4 (#107)

Math benchmarks
BenchmarkERNIE 5.0 0110Longcat Flash Chat
LMArena Math14371442

Knowledge Too close to call

ERNIE 5.0 0110: 39.8 (#128), Longcat Flash Chat: 40.6 (#116)

Knowledge benchmarks
BenchmarkERNIE 5.0 0110Longcat Flash Chat
LMArena Expert14281454

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Longcat Flash Chat: —

Multimodal benchmarks
BenchmarkERNIE 5.0 0110Longcat Flash Chat
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Longcat Flash Chat: 51.9 (#101)

Multilingual benchmarks
BenchmarkERNIE 5.0 0110Longcat Flash Chat
LMArena Non-English14361404
LMArena Chinese15121465
LMArena French14671456
LMArena German14601408
LMArena Japanese13821373
LMArena Korean14061371
LMArena Russian14461395
LMArena Spanish14731445

Instruction Following Too close to call

ERNIE 5.0 0110: 74.5 (#92), Longcat Flash Chat: 74.4 (#96)

Instruction Following benchmarks
BenchmarkERNIE 5.0 0110Longcat Flash Chat
LMArena Instruction Following14131411

Long Context Too close to call

ERNIE 5.0 0110: 43.4 (#95), Longcat Flash Chat: 43.5 (#93)

Long Context benchmarks
BenchmarkERNIE 5.0 0110Longcat Flash Chat
LMArena Longer Query14221425

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Longcat Flash Chat: 61.0 (#91)

Writing & Preference benchmarks
BenchmarkERNIE 5.0 0110Longcat Flash Chat
LMArena Text14451427
LMArena Creative Writing14261388
LMArena Multi-Turn14341418

Frequently asked questions

Is ERNIE 5.0 0110 better than Longcat Flash Chat?

ERNIE 5.0 0110 and Longcat Flash Chat score almost the same on the Noometry Index (41.8 vs 42.1), so choose on price, context window or the category you care about most.

Is ERNIE 5.0 0110 or Longcat Flash Chat better for coding?

They score almost the same on coding (43.0 vs 43.5); test both on your own repository before choosing.

How many benchmarks do ERNIE 5.0 0110 and Longcat Flash Chat share?

18 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Longcat Flash Chat has 19.

Related comparisons

Go deeper