Model comparison

ERNIE 5.1 vs Qwen Turbo

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Summary

  • The widest gap is in math, where ERNIE 5.1 leads 40.3 to 15.3.

Side by side

ERNIE 5.1 and Qwen Turbo specifications
ERNIE 5.1Qwen Turbo
ProviderBaiduAlibaba (Qwen)
Noometry Index43.827.1
Released—2024-11-01
WeightsProprietaryProprietary
Context window—1M
Max output—16K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.20
Results tracked193

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

ERNIE 5.1: 44.0 (#76), Qwen Turbo: —

Coding benchmarks
BenchmarkERNIE 5.1Qwen Turbo
LMArena Coding1488—

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Qwen Turbo: —

Agentic & Tool Use benchmarks
BenchmarkERNIE 5.1Qwen Turbo
LMArena Search1227—

Reasoning Not comparable

ERNIE 5.1: 21.9 (#211), Qwen Turbo: —

Reasoning benchmarks
BenchmarkERNIE 5.1Qwen Turbo
NYT Connections (extended)23.4%—
LMArena Hard Prompts1481—

Math ERNIE 5.1 leads

ERNIE 5.1: 40.3 (#92), Qwen Turbo: 15.3 (#297)

Math benchmarks
BenchmarkERNIE 5.1Qwen Turbo
OTIS Mock AIME 2024-2025—6.1%
LMArena Math1481—
MATH Level 5—56.2%

Knowledge ERNIE 5.1 leads

ERNIE 5.1: 41.9 (#102), Qwen Turbo: 22.2 (#272)

Knowledge benchmarks
BenchmarkERNIE 5.1Qwen Turbo
GPQA Diamond—41.8%
LMArena Expert1492—

Multilingual Not comparable

ERNIE 5.1: 55.5 (#29), Qwen Turbo: —

Multilingual benchmarks
BenchmarkERNIE 5.1Qwen Turbo
LMArena Non-English1454—
LMArena Chinese1508—
LMArena French1488—
LMArena German1470—
LMArena Japanese1422—
LMArena Korean1427—
LMArena Russian1459—
LMArena Spanish1473—

Instruction Following Not comparable

ERNIE 5.1: 76.7 (#37), Qwen Turbo: —

Instruction Following benchmarks
BenchmarkERNIE 5.1Qwen Turbo
LMArena Instruction Following1460—

Long Context Not comparable

ERNIE 5.1: 44.7 (#59), Qwen Turbo: —

Long Context benchmarks
BenchmarkERNIE 5.1Qwen Turbo
LMArena Longer Query1462—

Writing & Preference Not comparable

ERNIE 5.1: 65.1 (#52), Qwen Turbo: —

Writing & Preference benchmarks
BenchmarkERNIE 5.1Qwen Turbo
LMArena Text1468—
LMArena Creative Writing1441—
LMArena Multi-Turn1471—

Frequently asked questions

Is ERNIE 5.1 better than Qwen Turbo?

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 27.1 on the Noometry Index.

How many benchmarks do ERNIE 5.1 and Qwen Turbo share?

0 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Qwen Turbo has 3.

Related comparisons

Go deeper