Noometry

Model comparison

ERNIE 5.0 0110 vs GPT-3.5-turbo

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 23.2 on the Noometry Index.

Last verified . 17 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

GPT-3.5-turbo OpenAI

23.2

Rank #350 Confirmed

Summary

  • They share 17 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 8 categories and GPT-3.5-turbo in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 25.3.

Side by side

ERNIE 5.0 0110GPT-3.5-turbo
ProviderBaiduOpenAI
Noometry Index41.823.2
Released—2023-03-01
WeightsProprietaryProprietary
Context window—16K
Max output—4K
Input $ / M tokens—$0.50
Output $ / M tokens—$1.50
Results tracked2044

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), GPT-3.5-turbo: 23.9 (#331)

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
LMArena Coding14551136
WeirdML—3.5%
BigCodeBench Instruct—39.1%
BigCodeBench Complete—50.6%
HumanEval+—70.7%
MBPP+—69.7%

Agentic & Tool Use Not comparable

ERNIE 5.0 0110: —, GPT-3.5-turbo: —

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
METR Time Horizons—21.5%

Reasoning ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 17.0 (#297), GPT-3.5-turbo: 13.8 (#332)

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
LMArena Hard Prompts14451108
NYT Connections (extended)10.3%—
Chess Puzzles—0%
Thematic Generalization41.7%—
Mystery Game Puzzles—3%
DTBench—48.5%
LMCA—9.7%
Adversarial NLI—58.1%
BIG-Bench Hard—61.6%
CommonsenseQA 2.0—57%
Epoch Capabilities Index—118.55
ForecastBench—50.4
WinoGrande—81.6%

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), GPT-3.5-turbo: 6.3 (#327)

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
LMArena Math14371142
FrontierMath (Tiers 1-3)—0%
OTIS Mock AIME 2024-2025—2.2%
MATH Level 5—15.9%
GSM8K—57.8%

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), GPT-3.5-turbo: 10.0 (#303)

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
LMArena Expert14281070
GPQA Diamond—28%
ARC (AI2) Challenge—87.4%
BoolQ—87%
MMLU—71.4%
OpenBookQA—86%
TriviaQA—85.8%

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), GPT-3.5-turbo: —

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), GPT-3.5-turbo: 31.5 (#258)

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
LMArena Non-English14361108
LMArena Chinese15121075
LMArena French14671118
LMArena German14601090
LMArena Japanese13821043
LMArena Korean14061019
LMArena Russian14461123
LMArena Spanish14731121

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), GPT-3.5-turbo: 57.9 (#262)

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
LMArena Instruction Following14131119

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), GPT-3.5-turbo: 34.0 (#254)

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
LMArena Longer Query14221121

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), GPT-3.5-turbo: 25.3 (#305)

BenchmarkERNIE 5.0 0110GPT-3.5-turbo
LMArena Text14451125
LMArena Creative Writing14261092
LMArena Multi-Turn14341117
EQ-Bench Creative Writing—451

Frequently asked questions

Is ERNIE 5.0 0110 better than GPT-3.5-turbo?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 23.2 on the Noometry Index.

Is ERNIE 5.0 0110 or GPT-3.5-turbo better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 23.9 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and GPT-3.5-turbo share?

17 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and GPT-3.5-turbo has 44.

Related comparisons

Go deeper