Model comparison

ERNIE 5.1 vs Step 5 Preview

ERNIE 5.1 and Step 5 Preview score almost the same on the Noometry Index (43.1 vs 43.8), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

ERNIE 5.1 Baidu

43.1

Rank #87 Confirmed

Step 5 Preview StepFun

43.8

Rank #78 Reported

Summary

  • The widest gap is in reasoning, where Step 5 Preview leads 38.0 to 20.9.

Side by side

ERNIE 5.1 and Step 5 Preview specifications
ERNIE 5.1Step 5 Preview
ProviderBaiduStepFun
Noometry Index43.143.8
Released—2026-09-16
WeightsProprietaryProprietary
Context window—1.02M
Max output—66K
Input $ / M tokens—$1
Output $ / M tokens—$2.70
Results tracked193

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

ERNIE 5.1: 43.4 (#78), Step 5 Preview: 50.6 (#40)

Coding benchmarks
BenchmarkERNIE 5.1Step 5 Preview
LMArena WebDev—1569
SciCode—58.9%
LMArena Coding1488—

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkERNIE 5.1Step 5 Preview
LMArena Search1227—

Reasoning Step 5 Preview leads

ERNIE 5.1: 20.9 (#209), Step 5 Preview: 38.0 (#58)

Reasoning benchmarks
BenchmarkERNIE 5.1Step 5 Preview
NYT Connections (extended)23.4%—
CritPt—20.9%
LMArena Hard Prompts1481—

Math Not comparable

ERNIE 5.1: 37.5 (#96), Step 5 Preview: —

Math benchmarks
BenchmarkERNIE 5.1Step 5 Preview
LMArena Math1481—

Knowledge Not comparable

ERNIE 5.1: 41.2 (#103), Step 5 Preview: —

Knowledge benchmarks
BenchmarkERNIE 5.1Step 5 Preview
LMArena Expert1491—

Multilingual Not comparable

ERNIE 5.1: 55.7 (#28), Step 5 Preview: —

Multilingual benchmarks
BenchmarkERNIE 5.1Step 5 Preview
LMArena Non-English1455—
LMArena Chinese1507—
LMArena French1486—
LMArena German1470—
LMArena Japanese1422—
LMArena Korean1428—
LMArena Russian1459—
LMArena Spanish1472—

Instruction Following Not comparable

ERNIE 5.1: 76.9 (#35), Step 5 Preview: —

Instruction Following benchmarks
BenchmarkERNIE 5.1Step 5 Preview
LMArena Instruction Following1460—

Long Context Not comparable

ERNIE 5.1: 44.7 (#56), Step 5 Preview: —

Long Context benchmarks
BenchmarkERNIE 5.1Step 5 Preview
LMArena Longer Query1462—

Writing & Preference Not comparable

ERNIE 5.1: 65.3 (#50), Step 5 Preview: —

Writing & Preference benchmarks
BenchmarkERNIE 5.1Step 5 Preview
LMArena Text1468—
LMArena Creative Writing1440—
LMArena Multi-Turn1471—

Frequently asked questions

Is ERNIE 5.1 better than Step 5 Preview?

ERNIE 5.1 and Step 5 Preview score almost the same on the Noometry Index (43.1 vs 43.8), so choose on price, context window or the category you care about most.

Is ERNIE 5.1 or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 50.6 versus 43.4 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Step 5 Preview share?

0 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Step 5 Preview has 3.

Related comparisons

Go deeper