Model comparison

ERNIE 5.0 0110 vs Olmo 3.1 32b Think

ERNIE 5.0 0110 is the stronger model overall, scoring 41.2 to 37.3 on the Noometry Index.

Last verified . 15 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.2

Rank #129 Confirmed

Summary

  • They share 15 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 7 categories and Olmo 3.1 32b Think in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.4 to 46.4.
  • Olmo 3.1 32b Think has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110 and Olmo 3.1 32b Think specifications
ERNIE 5.0 0110Olmo 3.1 32b Think
ProviderBaiduAllen Institute for AI (Ai2)
Noometry Index41.237.3
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2015

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 42.3 (#94), Olmo 3.1 32b Think: 37.1 (#186)

Coding benchmarks
BenchmarkERNIE 5.0 0110Olmo 3.1 32b Think
LMArena Coding14551292

Reasoning Olmo 3.1 32b Think leads

ERNIE 5.0 0110: 16.3 (#296), Olmo 3.1 32b Think: 24.1 (#151)

Reasoning benchmarks
BenchmarkERNIE 5.0 0110Olmo 3.1 32b Think
LMArena Hard Prompts14461272
NYT Connections (extended)10.3%—
Thematic Generalization41.7%—

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 36.5 (#111), Olmo 3.1 32b Think: 33.6 (#170)

Math benchmarks
BenchmarkERNIE 5.0 0110Olmo 3.1 32b Think
LMArena Math14371305

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.2 (#125), Olmo 3.1 32b Think: 35.0 (#178)

Knowledge benchmarks
BenchmarkERNIE 5.0 0110Olmo 3.1 32b Think
LMArena Expert14271294

Multimodal Not comparable

ERNIE 5.0 0110: 39.1 (#49), Olmo 3.1 32b Think: —

Multimodal benchmarks
BenchmarkERNIE 5.0 0110Olmo 3.1 32b Think
LMArena Vision1248—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.3 (#47), Olmo 3.1 32b Think: 38.3 (#226)

Multilingual benchmarks
BenchmarkERNIE 5.0 0110Olmo 3.1 32b Think
LMArena Non-English14361210
LMArena Chinese15121241
LMArena French14661262
LMArena German14621260
LMArena Russian14461193
LMArena Spanish14731288
LMArena Japanese1383—
LMArena Korean1406—

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.7 (#88), Olmo 3.1 32b Think: 65.8 (#213)

Instruction Following benchmarks
BenchmarkERNIE 5.0 0110Olmo 3.1 32b Think
LMArena Instruction Following14131246

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#90), Olmo 3.1 32b Think: 38.6 (#190)

Long Context benchmarks
BenchmarkERNIE 5.0 0110Olmo 3.1 32b Think
LMArena Longer Query14221272

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.4 (#64), Olmo 3.1 32b Think: 46.4 (#215)

Writing & Preference benchmarks
BenchmarkERNIE 5.0 0110Olmo 3.1 32b Think
LMArena Text14451271
LMArena Creative Writing14261226
LMArena Multi-Turn14331252

Frequently asked questions

Is ERNIE 5.0 0110 better than Olmo 3.1 32b Think?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.2 to 37.3 on the Noometry Index.

Is ERNIE 5.0 0110 or Olmo 3.1 32b Think better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 42.3 versus 37.1 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Olmo 3.1 32b Think share?

15 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Olmo 3.1 32b Think has 15.

Related comparisons

Go deeper