Noometry

Model comparison

ERNIE 5.1 vs gpt-oss-120b

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 36.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

gpt-oss-120b OpenAI

36.3

Rank #217 Confirmed

Summary

  • They share 17 benchmarks with published results for both. ERNIE 5.1 scores higher in 6 categories and gpt-oss-120b in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.1 leads 65.1 to 46.5.
  • gpt-oss-120b has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.1gpt-oss-120b
ProviderBaiduOpenAI
Noometry Index43.836.3
Released—2025-08-05
WeightsProprietaryOpen
Context window—131K
Max output—41K
Input $ / M tokens—$0.037
Output $ / M tokens—$0.17
Results tracked1948

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.1 leads

ERNIE 5.1: 44.0 (#76), gpt-oss-120b: 33.5 (#256)

BenchmarkERNIE 5.1gpt-oss-120b
LMArena Coding14881380
SWE-bench Verified (bash only)—26%
Aider Polyglot—41.8%
SciCode—36%
WeirdML—48.2%
ALE-Bench—575.62
AlgoTune—1.41

Agentic & Tool Use Not comparable

ERNIE 5.1: —, gpt-oss-120b: 12.2 (#153)

BenchmarkERNIE 5.1gpt-oss-120b
Terminal-Bench—18.7%
APEX-Agents—4.4%
LMArena Search1227—
METR Time Horizons—56.6%
Vending-Bench 2—-21.53

Reasoning ERNIE 5.1 leads

ERNIE 5.1: 21.9 (#211), gpt-oss-120b: 20.0 (#245)

BenchmarkERNIE 5.1gpt-oss-120b
LMArena Hard Prompts14811364
SimpleBench—22.1%
Kagi LLM Benchmark—58.6%
NYT Connections (extended)23.4%—
CritPt—1.1%
Chess Puzzles—20%
Mystery Game Puzzles—2%
DTBench—76.3%
LMCA—22.1%
Surface Evolver Bench—25%
Epoch Capabilities Index—139.93

Math gpt-oss-120b leads

ERNIE 5.1: 40.3 (#92), gpt-oss-120b: 52.5 (#50)

BenchmarkERNIE 5.1gpt-oss-120b
LMArena Math14811389
OTIS Mock AIME 2024-2025—88.9%
Omni-MATH—68.8%

Knowledge Too close to call

ERNIE 5.1: 41.9 (#102), gpt-oss-120b: 42.4 (#96)

BenchmarkERNIE 5.1gpt-oss-120b
LMArena Expert14921356
GPQA Diamond—75.8%
MMLU-Pro—79.5%
Confabulations—15.7%
Vectara Hallucination Rate—14.2%
GPQA (HELM)—68.4%

Multilingual ERNIE 5.1 leads

ERNIE 5.1: 55.5 (#29), gpt-oss-120b: 48.0 (#147)

BenchmarkERNIE 5.1gpt-oss-120b
LMArena Non-English14541351
LMArena Chinese15081385
LMArena French14881369
LMArena German14701353
LMArena Japanese14221331
LMArena Korean14271282
LMArena Russian14591343
LMArena Spanish14731389

Instruction Following ERNIE 5.1 leads

ERNIE 5.1: 76.7 (#37), gpt-oss-120b: 69.3 (#173)

BenchmarkERNIE 5.1gpt-oss-120b
LMArena Instruction Following14601318
IFEval—83.6%

Long Context ERNIE 5.1 leads

ERNIE 5.1: 44.7 (#59), gpt-oss-120b: 31.4 (#278)

BenchmarkERNIE 5.1gpt-oss-120b
LMArena Longer Query14621319
Fiction.LiveBench—44.4%

Writing & Preference ERNIE 5.1 leads

ERNIE 5.1: 65.1 (#52), gpt-oss-120b: 46.5 (#217)

BenchmarkERNIE 5.1gpt-oss-120b
LMArena Text14681365
LMArena Creative Writing14411275
LMArena Multi-Turn14711340
Short-Story Creative Writing—77.1%
EQ-Bench Creative Writing—961
WildBench—84.5%

Frequently asked questions

Is ERNIE 5.1 better than gpt-oss-120b?

ERNIE 5.1 is the stronger model overall, scoring 43.8 to 36.3 on the Noometry Index.

Is ERNIE 5.1 or gpt-oss-120b better for coding?

ERNIE 5.1 scores higher on coding benchmarks: 44.0 versus 33.5 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and gpt-oss-120b share?

17 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and gpt-oss-120b has 48.

Related comparisons

Go deeper