Noometry

Model comparison

ERNIE 5.1 vs Gemini 3.5 Flash

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 43.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Gemini 3.5 Flash Google

54.2

Rank #32 Confirmed

Summary

  • They share 18 benchmarks with published results for both. ERNIE 5.1 scores higher in 0 categories and Gemini 3.5 Flash in 8 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.5 Flash leads 62.8 to 21.9.
  • The biggest single-benchmark swing is NYT Connections (extended): 23.4% for ERNIE 5.1 and 92.6% for Gemini 3.5 Flash.

Side by side

ERNIE 5.1Gemini 3.5 Flash
ProviderBaiduGoogle
Noometry Index43.854.2
Released—2026-05-19
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$1.50
Output $ / M tokens—$9
Results tracked1954

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash leads

ERNIE 5.1: 44.0 (#76), Gemini 3.5 Flash: 49.4 (#49)

BenchmarkERNIE 5.1Gemini 3.5 Flash
LMArena Coding14881492
SWE-bench Verified—79.3%
DeepSWE—37.4%
LMArena WebDev—1499
SciCode—53.1%
WeirdML—62.6%
ALE-Bench—911.02

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Gemini 3.5 Flash: 24.7 (#114)

BenchmarkERNIE 5.1Gemini 3.5 Flash
APEX-Agents—27.5%
GBAEval—6.7%
GDP.pdf—14%
LMArena Search1227—
Vending-Bench 2—5,396

Reasoning Gemini 3.5 Flash leads

ERNIE 5.1: 21.9 (#211), Gemini 3.5 Flash: 62.8 (#18)

BenchmarkERNIE 5.1Gemini 3.5 Flash
NYT Connections (extended)23.4%92.6%
LMArena Hard Prompts14811488
ARC-AGI-2—72.1%
SimpleBench—76.7%
ARC-AGI-1—92.5%
CritPt—13.1%
Chess Puzzles—50%
EnigmaEval—25.4%
EBR-Bench—4.8%
Mystery Game Puzzles—32%
DTBench—94.7%
LMCA—47.1%
Surface Evolver Bench—58.1%
Epoch Capabilities Index—154.46
ForecastBench—59

Math Gemini 3.5 Flash leads

ERNIE 5.1: 40.3 (#92), Gemini 3.5 Flash: 60.7 (#36)

BenchmarkERNIE 5.1Gemini 3.5 Flash
LMArena Math14811504
FrontierMath (Tiers 1-3)—62.8%
FrontierMath Tier 4—26.8%
MathArena Final-Answer Competitions—76.3%
OTIS Mock AIME 2024-2025—95.6%
ProofBench—31%
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%

Knowledge Gemini 3.5 Flash leads

ERNIE 5.1: 41.9 (#102), Gemini 3.5 Flash: 66.3 (#11)

BenchmarkERNIE 5.1Gemini 3.5 Flash
LMArena Expert14921495
GPQA Diamond—92.8%
SimpleQA Verified—66.2%

Multimodal Not comparable

ERNIE 5.1: —, Gemini 3.5 Flash: 45.7 (#15)

BenchmarkERNIE 5.1Gemini 3.5 Flash
LMArena Vision—1310
Blueprint-Bench 2—33.6%
LMArena Document—1463

Multilingual Gemini 3.5 Flash leads

ERNIE 5.1: 55.5 (#29), Gemini 3.5 Flash: 57.0 (#13)

BenchmarkERNIE 5.1Gemini 3.5 Flash
LMArena Non-English14541476
LMArena Chinese15081526
LMArena French14881490
LMArena German14701492
LMArena Japanese14221486
LMArena Korean14271451
LMArena Russian14591493
LMArena Spanish14731480

Instruction Following Too close to call

ERNIE 5.1: 76.7 (#37), Gemini 3.5 Flash: 77.0 (#30)

BenchmarkERNIE 5.1Gemini 3.5 Flash
LMArena Instruction Following14601467

Long Context Too close to call

ERNIE 5.1: 44.7 (#59), Gemini 3.5 Flash: 45.4 (#38)

BenchmarkERNIE 5.1Gemini 3.5 Flash
LMArena Longer Query14621482

Writing & Preference Too close to call

ERNIE 5.1: 65.1 (#52), Gemini 3.5 Flash: 65.5 (#47)

BenchmarkERNIE 5.1Gemini 3.5 Flash
LMArena Text14681482
LMArena Creative Writing14411470
LMArena Multi-Turn14711481
EQ-Bench 4—1087

Frequently asked questions

Is ERNIE 5.1 better than Gemini 3.5 Flash?

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 43.8 on the Noometry Index.

Is ERNIE 5.1 or Gemini 3.5 Flash better for coding?

Gemini 3.5 Flash scores higher on coding benchmarks: 49.4 versus 44.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Gemini 3.5 Flash share?

18 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Gemini 3.5 Flash has 54.

Related comparisons

Go deeper