Noometry

Model comparison

ERNIE 5.1 vs Gemini 3.1 Flash Lite

ERNIE 5.1 is the stronger model overall, scoring 43.1 to 40.4 on the Noometry Index.

Last verified . 18 shared benchmarks.

ERNIE 5.1 Baidu

43.1

Rank #87 Confirmed

Gemini 3.1 Flash Lite Google

40.4

Rank #141 Confirmed

Summary

  • They share 18 benchmarks with published results for both. ERNIE 5.1 scores higher in 5 categories and Gemini 3.1 Flash Lite in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in coding, where ERNIE 5.1 leads 43.4 to 37.5.
  • The biggest single-benchmark swing is NYT Connections (extended): 23.4% for ERNIE 5.1 and 8.2% for Gemini 3.1 Flash Lite.

Side by side

ERNIE 5.1Gemini 3.1 Flash Lite
ProviderBaiduGoogle
Noometry Index43.140.4
Released—2026-03-03
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.25
Output $ / M tokens—$1.50
Results tracked1938

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding ERNIE 5.1 leads

ERNIE 5.1: 43.4 (#78), Gemini 3.1 Flash Lite: 37.5 (#179)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
LMArena Coding14881400
LMArena WebDev—1256
SciCode—41.9%
WeirdML—52.2%
ALE-Bench—797.73

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Gemini 3.1 Flash Lite: 29.9 (#72)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
DeepResearch Bench—37.3%
LMArena Search1227—

Reasoning Gemini 3.1 Flash Lite leads

ERNIE 5.1: 20.9 (#209), Gemini 3.1 Flash Lite: 22.3 (#181)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
NYT Connections (extended)23.4%8.2%
LMArena Hard Prompts14811407
Kagi LLM Benchmark—67.2%
CritPt—1.1%
Chess Puzzles—25%
EnigmaEval—3%
Thematic Generalization—63.3%
DTBench—76.8%
LMCA—35%
Epoch Capabilities Index—144.45
ForecastBench—54.4

Math Gemini 3.1 Flash Lite leads

ERNIE 5.1: 37.5 (#96), Gemini 3.1 Flash Lite: 39.5 (#82)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
LMArena Math14811427
FrontierMath (Tiers 1-3)—27.7%
OTIS Mock AIME 2024-2025—80%

Knowledge Too close to call

ERNIE 5.1: 41.2 (#103), Gemini 3.1 Flash Lite: 41.7 (#95)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
LMArena Expert14911397
GPQA Diamond—81.8%
Humanity's Last Exam—8.6%
Vectara Hallucination Rate—8.2%

Multimodal Not comparable

ERNIE 5.1: —, Gemini 3.1 Flash Lite: 38.7 (#57)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
LMArena Vision—1240

Multilingual ERNIE 5.1 leads

ERNIE 5.1: 55.7 (#28), Gemini 3.1 Flash Lite: 52.5 (#82)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
LMArena Non-English14551410
LMArena Chinese15071461
LMArena French14861423
LMArena German14701429
LMArena Japanese14221411
LMArena Korean14281393
LMArena Russian14591420
LMArena Spanish14721420

Instruction Following ERNIE 5.1 leads

ERNIE 5.1: 76.9 (#35), Gemini 3.1 Flash Lite: 72.9 (#126)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
LMArena Instruction Following14601376

Long Context ERNIE 5.1 leads

ERNIE 5.1: 44.7 (#56), Gemini 3.1 Flash Lite: 42.5 (#117)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
LMArena Longer Query14621394

Writing & Preference ERNIE 5.1 leads

ERNIE 5.1: 65.3 (#50), Gemini 3.1 Flash Lite: 61.0 (#90)

BenchmarkERNIE 5.1Gemini 3.1 Flash Lite
LMArena Text14681416
LMArena Creative Writing14401401
LMArena Multi-Turn14711417

Frequently asked questions

Is ERNIE 5.1 better than Gemini 3.1 Flash Lite?

ERNIE 5.1 is the stronger model overall, scoring 43.1 to 40.4 on the Noometry Index.

Is ERNIE 5.1 or Gemini 3.1 Flash Lite better for coding?

ERNIE 5.1 scores higher on coding benchmarks: 43.4 versus 37.5 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Gemini 3.1 Flash Lite share?

18 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Gemini 3.1 Flash Lite has 38.

Related comparisons

Go deeper