Noometry

Model comparison

ERNIE 5.1 vs Step 3.7 Flash

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 37.3 on the Noometry Index.

Last verified . 1 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • They share 1 benchmark with published results for both. ERNIE 5.1 scores higher in 2 categories and Step 3.7 Flash in 1 category; 2 gaps are clear of the uncertainty.
  • The widest gap is in coding, where ERNIE 5.1 leads 44.0 to 40.0.
  • The biggest single-benchmark swing is NYT Connections (extended): 23.4% for ERNIE 5.1 and 39.7% for Step 3.7 Flash.
  • Step 3.7 Flash has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.1Step 3.7 Flash
ProviderBaiduStepFun
Noometry Index43.837.3
Released—2026-05-29
WeightsProprietaryOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked195

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.1 leads

ERNIE 5.1: 44.0 (#76), Step 3.7 Flash: 40.0 (#150)

BenchmarkERNIE 5.1Step 3.7 Flash
SciCode—40%
LMArena Coding1488—
ALE-Bench—694.12

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Step 3.7 Flash: —

BenchmarkERNIE 5.1Step 3.7 Flash
LMArena Search1227—

Reasoning Too close to call

ERNIE 5.1: 21.9 (#211), Step 3.7 Flash: 21.6 (#219)

BenchmarkERNIE 5.1Step 3.7 Flash
NYT Connections (extended)23.4%39.7%
CritPt—2.3%
LMArena Hard Prompts1481—

Math Step 3.7 Flash leads

ERNIE 5.1: 40.3 (#92), Step 3.7 Flash: 42.9 (#82)

BenchmarkERNIE 5.1Step 3.7 Flash
MathArena Final-Answer Competitions—68.5%
LMArena Math1481—

Knowledge Not comparable

ERNIE 5.1: 41.9 (#102), Step 3.7 Flash: —

BenchmarkERNIE 5.1Step 3.7 Flash
LMArena Expert1492—

Multilingual Not comparable

ERNIE 5.1: 55.5 (#29), Step 3.7 Flash: —

BenchmarkERNIE 5.1Step 3.7 Flash
LMArena Non-English1454—
LMArena Chinese1508—
LMArena French1488—
LMArena German1470—
LMArena Japanese1422—
LMArena Korean1427—
LMArena Russian1459—
LMArena Spanish1473—

Instruction Following Not comparable

ERNIE 5.1: 76.7 (#37), Step 3.7 Flash: —

BenchmarkERNIE 5.1Step 3.7 Flash
LMArena Instruction Following1460—

Long Context Not comparable

ERNIE 5.1: 44.7 (#59), Step 3.7 Flash: —

BenchmarkERNIE 5.1Step 3.7 Flash
LMArena Longer Query1462—

Writing & Preference Not comparable

ERNIE 5.1: 65.1 (#52), Step 3.7 Flash: —

BenchmarkERNIE 5.1Step 3.7 Flash
LMArena Text1468—
LMArena Creative Writing1441—
LMArena Multi-Turn1471—

Frequently asked questions

Is ERNIE 5.1 better than Step 3.7 Flash?

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 37.3 on the Noometry Index.

Is ERNIE 5.1 or Step 3.7 Flash better for coding?

ERNIE 5.1 scores higher on coding benchmarks: 44.0 versus 40.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Step 3.7 Flash share?

1 benchmark has published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper