Model comparison

ERNIE 5.1 vs Muse Spark 1.3

Muse Spark 1.3 is the stronger model overall, scoring 54.4 to 43.1 on the Noometry Index.

Last verified . 16 shared benchmarks.

ERNIE 5.1 Baidu

43.1

Rank #87 Confirmed

Muse Spark 1.3 Meta

54.4

Rank #27 Confirmed

Summary

  • They share 16 benchmarks with published results for both. ERNIE 5.1 scores higher in 0 categories and Muse Spark 1.3 in 8 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where Muse Spark 1.3 leads 72.4 to 37.5.
  • The biggest single-benchmark swing is NYT Connections (extended): 23.4% for ERNIE 5.1 and 85.1% for Muse Spark 1.3.

Side by side

ERNIE 5.1 and Muse Spark 1.3 specifications
ERNIE 5.1Muse Spark 1.3
ProviderBaiduMeta
Noometry Index43.154.4
Released—2026-09-02
WeightsProprietaryProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked1934

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.3 leads

ERNIE 5.1: 43.4 (#78), Muse Spark 1.3: 56.1 (#18)

Coding benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
LMArena Coding14881516
CursorBench—41.6%
LMArena WebDev—1655
SciCode—59.7%

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Muse Spark 1.3: 38.6 (#28)

Agentic & Tool Use benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
APEX-Agents—57.8%
GDP.pdf—27.6%
LMArena Search1227—

Reasoning Muse Spark 1.3 leads

ERNIE 5.1: 20.9 (#209), Muse Spark 1.3: 52.9 (#27)

Reasoning benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
NYT Connections (extended)23.4%85.1%
LMArena Hard Prompts14811503
CritPt—24.9%
Chess Puzzles—38%
Mystery Game Puzzles—25%
DTBench—96.5%
LMCA—53.9%
Bench to the Future 3—0.14
Epoch Capabilities Index—156.89

Math Muse Spark 1.3 leads

ERNIE 5.1: 37.5 (#96), Muse Spark 1.3: 72.4 (#16)

Math benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
LMArena Math14811497
FrontierMath (Tiers 1-3)—74.4%
FrontierMath Tier 4—46.3%
OTIS Mock AIME 2024-2025—99.2%

Knowledge Too close to call

ERNIE 5.1: 41.2 (#103), Muse Spark 1.3: 42.0 (#92)

Knowledge benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
LMArena Expert14911516

Multimodal Not comparable

ERNIE 5.1: —, Muse Spark 1.3: 43.0 (#21)

Multimodal benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
LMArena Vision—1310
LMArena Document—1471

Multilingual Muse Spark 1.3 leads

ERNIE 5.1: 55.7 (#28), Muse Spark 1.3: 57.8 (#6)

Multilingual benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
LMArena Non-English14551485
LMArena Chinese15071527
LMArena French14861534
LMArena Korean14281513
LMArena Russian14591491
LMArena Spanish14721485
LMArena German1470—
LMArena Japanese1422—

Instruction Following Too close to call

ERNIE 5.1: 76.9 (#35), Muse Spark 1.3: 77.8 (#14)

Instruction Following benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
LMArena Instruction Following14601481

Long Context Too close to call

ERNIE 5.1: 44.7 (#56), Muse Spark 1.3: 45.7 (#29)

Long Context benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
LMArena Longer Query14621491

Writing & Preference Muse Spark 1.3 leads

ERNIE 5.1: 65.3 (#50), Muse Spark 1.3: 73.7 (#10)

Writing & Preference benchmarks
BenchmarkERNIE 5.1Muse Spark 1.3
LMArena Text14681490
LMArena Creative Writing14401450
LMArena Multi-Turn14711486
EQ-Bench Creative Writing—1906

Frequently asked questions

Is ERNIE 5.1 better than Muse Spark 1.3?

Muse Spark 1.3 is the stronger model overall, scoring 54.4 to 43.1 on the Noometry Index.

Is ERNIE 5.1 or Muse Spark 1.3 better for coding?

Muse Spark 1.3 scores higher on coding benchmarks: 56.1 versus 43.4 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Muse Spark 1.3 share?

16 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Muse Spark 1.3 has 34.

Related comparisons

Go deeper