Model comparison

ERNIE 5.0 0110 vs Gemma 3n E4b IT

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 37.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

ERNIE 5.0 0110 Baidu

41.8

Rank #129 Confirmed

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Summary

  • They share 17 benchmarks with published results for both. ERNIE 5.0 0110 scores higher in 7 categories and Gemma 3n E4b IT in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where ERNIE 5.0 0110 leads 63.1 to 50.1.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

ERNIE 5.0 0110 and Gemma 3n E4b IT specifications
ERNIE 5.0 0110Gemma 3n E4b IT
ProviderBaiduGoogle
Noometry Index41.837.3
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2018

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.0 (#94), Gemma 3n E4b IT: 37.0 (#198)

Coding benchmarks
BenchmarkERNIE 5.0 0110Gemma 3n E4b IT
LMArena Coding14551268

Reasoning Gemma 3n E4b IT leads

ERNIE 5.0 0110: 17.0 (#297), Gemma 3n E4b IT: 19.9 (#247)

Reasoning benchmarks
BenchmarkERNIE 5.0 0110Gemma 3n E4b IT
LMArena Hard Prompts14451284
Kagi LLM Benchmark—31.5%
NYT Connections (extended)10.3%—
Thematic Generalization41.7%—

Math ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.3 (#110), Gemma 3n E4b IT: 35.1 (#188)

Math benchmarks
BenchmarkERNIE 5.0 0110Gemma 3n E4b IT
LMArena Math14371251

Knowledge ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 39.8 (#128), Gemma 3n E4b IT: 34.2 (#198)

Knowledge benchmarks
BenchmarkERNIE 5.0 0110Gemma 3n E4b IT
LMArena Expert14281246

Multimodal Not comparable

ERNIE 5.0 0110: 39.9 (#53), Gemma 3n E4b IT: —

Multimodal benchmarks
BenchmarkERNIE 5.0 0110Gemma 3n E4b IT
LMArena Vision1249—

Multilingual ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 54.1 (#49), Gemma 3n E4b IT: 43.4 (#183)

Multilingual benchmarks
BenchmarkERNIE 5.0 0110Gemma 3n E4b IT
LMArena Non-English14361285
LMArena Chinese15121309
LMArena French14671330
LMArena German14601311
LMArena Japanese13821272
LMArena Korean14061259
LMArena Russian14461288
LMArena Spanish14731305

Instruction Following ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 74.5 (#92), Gemma 3n E4b IT: 66.1 (#210)

Instruction Following benchmarks
BenchmarkERNIE 5.0 0110Gemma 3n E4b IT
LMArena Instruction Following14131255

Long Context ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 43.4 (#95), Gemma 3n E4b IT: 38.7 (#191)

Long Context benchmarks
BenchmarkERNIE 5.0 0110Gemma 3n E4b IT
LMArena Longer Query14221276

Writing & Preference ERNIE 5.0 0110 leads

ERNIE 5.0 0110: 63.1 (#66), Gemma 3n E4b IT: 50.1 (#186)

Writing & Preference benchmarks
BenchmarkERNIE 5.0 0110Gemma 3n E4b IT
LMArena Text14451306
LMArena Creative Writing14261287
LMArena Multi-Turn14341276

Frequently asked questions

Is ERNIE 5.0 0110 better than Gemma 3n E4b IT?

ERNIE 5.0 0110 is the stronger model overall, scoring 41.8 to 37.3 on the Noometry Index.

Is ERNIE 5.0 0110 or Gemma 3n E4b IT better for coding?

ERNIE 5.0 0110 scores higher on coding benchmarks: 43.0 versus 37.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.0 0110 and Gemma 3n E4b IT share?

17 benchmarks have published results for both models. ERNIE 5.0 0110 has 20 scored results on Noometry and Gemma 3n E4b IT has 18.

Related comparisons

Go deeper