Model comparison

ERNIE 5.1 vs Qwen3 14B

ERNIE 5.1 is the stronger model overall, scoring 43.1 to 35.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

ERNIE 5.1 Baidu

43.1

Rank #87 Confirmed

Qwen3 14B Alibaba (Qwen)

35.0

Rank #222 Confirmed

Summary

  • The widest gap is in coding, where ERNIE 5.1 leads 43.4 to 36.7.
  • Qwen3 14B has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.1 and Qwen3 14B specifications
ERNIE 5.1Qwen3 14B
ProviderBaiduAlibaba (Qwen)
Noometry Index43.135.0
Released—2025-04
WeightsProprietaryOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.35
Output $ / M tokens—$1.40
Results tracked1912

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.1 leads

ERNIE 5.1: 43.4 (#78), Qwen3 14B: 36.7 (#191)

Coding benchmarks
BenchmarkERNIE 5.1Qwen3 14B
SciCode—31.6%
LMArena Coding1488—

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Qwen3 14B: 29.4 (#78)

Agentic & Tool Use benchmarks
BenchmarkERNIE 5.1Qwen3 14B
Berkeley Function Calling Leaderboard—41%
LMArena Search1227—

Reasoning ERNIE 5.1 leads

ERNIE 5.1: 20.9 (#209), Qwen3 14B: 18.1 (#272)

Reasoning benchmarks
BenchmarkERNIE 5.1Qwen3 14B
Kagi LLM Benchmark—49.1%
NYT Connections (extended)23.4%—
CritPt—0%
Chess Puzzles—4%
LMArena Hard Prompts1481—
DTBench—64%
LMCA—18.2%
Epoch Capabilities Index—138.23

Math Too close to call

ERNIE 5.1: 37.5 (#96), Qwen3 14B: 37.0 (#102)

Math benchmarks
BenchmarkERNIE 5.1Qwen3 14B
OTIS Mock AIME 2024-2025—66.4%
LMArena Math1481—

Knowledge ERNIE 5.1 leads

ERNIE 5.1: 41.2 (#103), Qwen3 14B: 39.2 (#124)

Knowledge benchmarks
BenchmarkERNIE 5.1Qwen3 14B
GPQA Diamond—63.8%
Vectara Hallucination Rate—5.4%
LMArena Expert1491—

Multilingual Not comparable

ERNIE 5.1: 55.7 (#28), Qwen3 14B: —

Multilingual benchmarks
BenchmarkERNIE 5.1Qwen3 14B
LMArena Non-English1455—
LMArena Chinese1507—
LMArena French1486—
LMArena German1470—
LMArena Japanese1422—
LMArena Korean1428—
LMArena Russian1459—
LMArena Spanish1472—

Instruction Following Not comparable

ERNIE 5.1: 76.9 (#35), Qwen3 14B: —

Instruction Following benchmarks
BenchmarkERNIE 5.1Qwen3 14B
LMArena Instruction Following1460—

Long Context ERNIE 5.1 leads

ERNIE 5.1: 44.7 (#56), Qwen3 14B: 38.0 (#201)

Long Context benchmarks
BenchmarkERNIE 5.1Qwen3 14B
Fiction.LiveBench—62.5%
LMArena Longer Query1462—

Writing & Preference Not comparable

ERNIE 5.1: 65.3 (#50), Qwen3 14B: —

Writing & Preference benchmarks
BenchmarkERNIE 5.1Qwen3 14B
LMArena Text1468—
LMArena Creative Writing1440—
LMArena Multi-Turn1471—

Frequently asked questions

Is ERNIE 5.1 better than Qwen3 14B?

ERNIE 5.1 is the stronger model overall, scoring 43.1 to 35.0 on the Noometry Index.

Is ERNIE 5.1 or Qwen3 14B better for coding?

ERNIE 5.1 scores higher on coding benchmarks: 43.4 versus 36.7 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Qwen3 14B share?

0 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Qwen3 14B has 12.

Related comparisons

Go deeper