# ERNIE 5.1 vs Gemini 2.5 Flash

> ERNIE 5.1 is the stronger model overall, scoring 43.1 to 39.0 on the Noometry Index.

- Canonical page: https://noometry.com/compare/ernie-5-1-vs-gemini-2-5-flash
- Last updated: 2026-10-10
- Shared benchmarks: 17

## Summary

- They share 17 benchmarks with published results for both. ERNIE 5.1 scores higher in 6 categories and Gemini 2.5 Flash in 2 categories; 6 gaps are clear of the uncertainty.
- The widest gap is in writing & preference, where ERNIE 5.1 leads 65.3 to 54.0.

## Snapshot

| | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| Provider | Baidu | Google |
| Noometry Index | 43.1 | 39.0 |
| Rank | 87 | 162 |
| Context | — | 1.05M |
| Input $/M | — | $0.30 |
| Output $/M | — | $2.50 |
| Weights | Proprietary | Proprietary |

## Coding

- ERNIE 5.1: 43.4 (#78)
- Gemini 2.5 Flash: 35.5 (#210)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| LMArena Coding | 1488 | 1424 |
| SWE-bench Verified (bash only) | — | 28.7% |
| Aider Polyglot | — | 55.1% |
| WeirdML | — | 41.9% |
| ALE-Bench | — | 661.88 |

## Agentic & Tool Use

- ERNIE 5.1: —
- Gemini 2.5 Flash: 30.6 (#67)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| Terminal-Bench | — | 17.1% |
| Berkeley Function Calling Leaderboard | — | 56.2% |
| TheAgentCompany | — | 41.1% |
| BALROG | — | 33.5% |
| LMArena Search | 1227 | — |
| Vending-Bench 2 | — | 548.84 |

## Reasoning

- ERNIE 5.1: 20.9 (#209)
- Gemini 2.5 Flash: 18.2 (#271)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| LMArena Hard Prompts | 1481 | 1422 |
| ARC-AGI-2 | — | 2.5% |
| SimpleBench | — | 41.2% |
| Kagi LLM Benchmark | — | 56.8% |
| NYT Connections (extended) | 23.4% | — |
| ARC-AGI-1 | — | 33.3% |
| CritPt | — | 1.1% |
| EnigmaEval | — | 2.7% |
| DTBench | — | 76.5% |
| LMCA | — | 27.5% |
| Epoch Capabilities Index | — | 143.04 |
| ForecastBench | — | 60.6 |

## Math

- ERNIE 5.1: 37.5 (#96)
- Gemini 2.5 Flash: 38.1 (#87)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| LMArena Math | 1481 | 1415 |
| OTIS Mock AIME 2024-2025 | — | 73.1% |
| Omni-MATH | — | 38.5% |
| FrontierMath (Feb 2025 set) | — | 4.8% |
| FrontierMath Tier 4 (v1) | — | 4.2% |

## Knowledge

- ERNIE 5.1: 41.2 (#103)
- Gemini 2.5 Flash: 36.1 (#162)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| LMArena Expert | 1491 | 1426 |
| Humanity's Last Exam | — | 12.1% |
| MMLU-Pro | — | 63.9% |
| Confabulations | — | 16.8% |
| Vectara Hallucination Rate | — | 7.8% |
| GPQA (HELM) | — | 39% |

## Multimodal

- ERNIE 5.1: —
- Gemini 2.5 Flash: 41.2 (#31)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| LMArena Vision | — | 1254 |
| GeoBench | — | 76% |
| VPCT | — | 46.2% |
| SpatialViz-Bench | — | 36.9% |

## Multilingual

- ERNIE 5.1: 55.7 (#28)
- Gemini 2.5 Flash: 52.5 (#83)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| LMArena Non-English | 1455 | 1410 |
| LMArena Chinese | 1507 | 1450 |
| LMArena French | 1486 | 1433 |
| LMArena German | 1470 | 1419 |
| LMArena Japanese | 1422 | 1403 |
| LMArena Korean | 1428 | 1385 |
| LMArena Russian | 1459 | 1415 |
| LMArena Spanish | 1472 | 1421 |

## Instruction Following

- ERNIE 5.1: 76.9 (#35)
- Gemini 2.5 Flash: 75.9 (#50)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| LMArena Instruction Following | 1460 | 1405 |
| IFEval | — | 89.8% |

## Long Context

- ERNIE 5.1: 44.7 (#56)
- Gemini 2.5 Flash: 47.5 (#16)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| LMArena Longer Query | 1462 | 1419 |
| Fiction.LiveBench | — | 77.8% |

## Writing & Preference

- ERNIE 5.1: 65.3 (#50)
- Gemini 2.5 Flash: 54.0 (#153)

| Benchmark | ERNIE 5.1 | Gemini 2.5 Flash |
|---|---|---|
| LMArena Text | 1468 | 1417 |
| LMArena Creative Writing | 1440 | 1400 |
| LMArena Multi-Turn | 1471 | 1408 |
| Short-Story Creative Writing | — | 76.5% |
| EQ-Bench Creative Writing | — | 1137 |
| WildBench | — | 81.7% |

## FAQ

### Is ERNIE 5.1 better than Gemini 2.5 Flash?

ERNIE 5.1 is the stronger model overall, scoring 43.1 to 39.0 on the Noometry Index.

### Is ERNIE 5.1 or Gemini 2.5 Flash better for coding?

ERNIE 5.1 scores higher on coding benchmarks: 43.4 versus 35.5 in the Noometry coding category.

### How many benchmarks do ERNIE 5.1 and Gemini 2.5 Flash share?

17 benchmarks have published results for both models. ERNIE 5.1 has 19 scored results on Noometry and Gemini 2.5 Flash has 54.