Noometry

Model comparison

ERNIE 5.1 vs Gemini 3.6 Flash

Gemini 3.6 Flash is the stronger model overall, scoring 54.1 to 43.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

ERNIE 5.1 Baidu

43.8

Rank #83 Confirmed

Gemini 3.6 Flash Google

54.1

Rank #33 Confirmed

Summary

  • They share 18 benchmarks with published results for both. ERNIE 5.1 scores higher in 0 categories and Gemini 3.6 Flash in 8 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.6 Flash leads 58.8 to 21.9.
  • The biggest single-benchmark swing is NYT Connections (extended): 23.4% for ERNIE 5.1 and 89% for Gemini 3.6 Flash.

Side by side

ERNIE 5.1Gemini 3.6 Flash
ProviderBaiduGoogle
Noometry Index43.854.1
Released—2026-07-21
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.75
Output $ / M tokens—$3.75
Results tracked1946

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.6 Flash leads

ERNIE 5.1: 44.0 (#76), Gemini 3.6 Flash: 50.0 (#48)

BenchmarkERNIE 5.1Gemini 3.6 Flash
LMArena Coding14881491
DeepSWE—46.7%
FrontierCode—34.4%
LMArena WebDev—1538
SciCode—52.7%
WeirdML—56.1%
ALE-Bench—715.52

Agentic & Tool Use Not comparable

ERNIE 5.1: —, Gemini 3.6 Flash: 32.3 (#65)

BenchmarkERNIE 5.1Gemini 3.6 Flash
APEX-Agents—46.9%
GDP.pdf—14%
LMArena Search1227—

Reasoning Gemini 3.6 Flash leads

ERNIE 5.1: 21.9 (#211), Gemini 3.6 Flash: 58.8 (#22)

BenchmarkERNIE 5.1Gemini 3.6 Flash
NYT Connections (extended)23.4%89%
LMArena Hard Prompts14811485
ARC-AGI-2—60.4%
ARC-AGI-1—91.2%
CritPt—10.6%
Chess Puzzles—43%
Mystery Game Puzzles—30%
DTBench—95.5%
LMCA—44.9%
Epoch Capabilities Index—154.25

Math Gemini 3.6 Flash leads

ERNIE 5.1: 40.3 (#92), Gemini 3.6 Flash: 57.3 (#40)

BenchmarkERNIE 5.1Gemini 3.6 Flash
LMArena Math14811505
FrontierMath (Tiers 1-3)—58.9%
FrontierMath Tier 4—22%
MathArena Final-Answer Competitions—70.8%
OTIS Mock AIME 2024-2025—94.2%
ProofBench—36%

Knowledge Gemini 3.6 Flash leads

ERNIE 5.1: 41.9 (#102), Gemini 3.6 Flash: 67.8 (#8)

BenchmarkERNIE 5.1Gemini 3.6 Flash
LMArena Expert14921488
GPQA Diamond—94.1%
SimpleQA Verified—66.2%

Multimodal Not comparable

ERNIE 5.1: —, Gemini 3.6 Flash: 38.5 (#64)

BenchmarkERNIE 5.1Gemini 3.6 Flash
LMArena Vision—1298
Blueprint-Bench 2—31.2%
Furniture Assembly—23.3%
LMArena Document—1456

Multilingual Gemini 3.6 Flash leads

ERNIE 5.1: 55.5 (#29), Gemini 3.6 Flash: 56.5 (#19)

BenchmarkERNIE 5.1Gemini 3.6 Flash
LMArena Non-English14541469
LMArena Chinese15081531
LMArena French14881504
LMArena German14701478
LMArena Japanese14221476
LMArena Korean14271431
LMArena Russian14591487
LMArena Spanish14731475

Instruction Following Too close to call

ERNIE 5.1: 76.7 (#37), Gemini 3.6 Flash: 77.0 (#33)

BenchmarkERNIE 5.1Gemini 3.6 Flash
LMArena Instruction Following14601466

Long Context Too close to call

ERNIE 5.1: 44.7 (#59), Gemini 3.6 Flash: 45.1 (#50)

BenchmarkERNIE 5.1Gemini 3.6 Flash
LMArena Longer Query14621474

Writing & Preference Gemini 3.6 Flash leads

ERNIE 5.1: 65.1 (#52), Gemini 3.6 Flash: 68.2 (#27)

BenchmarkERNIE 5.1Gemini 3.6 Flash
LMArena Text14681479
LMArena Creative Writing14411465
LMArena Multi-Turn14711481
EQ-Bench Creative Writing—1604

Frequently asked questions

Is ERNIE 5.1 better than Gemini 3.6 Flash?

Gemini 3.6 Flash is the stronger model overall, scoring 54.1 to 43.8 on the Noometry Index.

Is ERNIE 5.1 or Gemini 3.6 Flash better for coding?

Gemini 3.6 Flash scores higher on coding benchmarks: 50.0 versus 44.0 in the Noometry coding category.

How many benchmarks do ERNIE 5.1 and Gemini 3.6 Flash share?

18 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Gemini 3.6 Flash has 46.

Related comparisons

Go deeper