Model comparison

Gemini Advanced 0514 vs Ministral 3B

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Summary

  • The widest gap is in knowledge, where Gemini Advanced 0514 leads 33.3 to 10.4.
  • Ministral 3B has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514 and Ministral 3B specifications
Gemini Advanced 0514Ministral 3B
ProviderGoogleMistral AI
Noometry Index37.726.2
Released—2024-10-01
WeightsProprietaryOpen
Context window—131K
Max output—262K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.10
Results tracked176

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini Advanced 0514: 36.6 (#205), Ministral 3B: —

Coding benchmarks
BenchmarkGemini Advanced 0514Ministral 3B
LMArena Coding1255—

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), Ministral 3B: 18.4 (#282)

Reasoning benchmarks
BenchmarkGemini Advanced 0514Ministral 3B
LMArena Hard Prompts1248—
DTBench—51.7%
LMCA—5.5%
Epoch Capabilities Index—118.1

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), Ministral 3B: 26.6 (#258)

Math benchmarks
BenchmarkGemini Advanced 0514Ministral 3B
LMArena Math1272—
MATH Level 5—14.4%

Knowledge Gemini Advanced 0514 leads

Gemini Advanced 0514: 33.3 (#205), Ministral 3B: 10.4 (#302)

Knowledge benchmarks
BenchmarkGemini Advanced 0514Ministral 3B
GPQA Diamond—25.3%
Vectara Hallucination Rate—7.3%
LMArena Expert1215—

Multilingual Not comparable

Gemini Advanced 0514: 42.6 (#192), Ministral 3B: —

Multilingual benchmarks
BenchmarkGemini Advanced 0514Ministral 3B
LMArena Non-English1274—
LMArena Chinese1274—
LMArena French1307—
LMArena German1275—
LMArena Japanese1242—
LMArena Korean1232—
LMArena Russian1283—
LMArena Spanish1242—

Instruction Following Not comparable

Gemini Advanced 0514: 66.0 (#212), Ministral 3B: —

Instruction Following benchmarks
BenchmarkGemini Advanced 0514Ministral 3B
LMArena Instruction Following1253—

Long Context Not comparable

Gemini Advanced 0514: 38.0 (#207), Ministral 3B: —

Long Context benchmarks
BenchmarkGemini Advanced 0514Ministral 3B
LMArena Longer Query1253—

Writing & Preference Not comparable

Gemini Advanced 0514: 48.5 (#200), Ministral 3B: —

Writing & Preference benchmarks
BenchmarkGemini Advanced 0514Ministral 3B
LMArena Text1279—
LMArena Creative Writing1284—
LMArena Multi-Turn1269—

Frequently asked questions

Is Gemini Advanced 0514 better than Ministral 3B?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 26.2 on the Noometry Index.

How many benchmarks do Gemini Advanced 0514 and Ministral 3B share?

0 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Ministral 3B has 6.

Related comparisons

Go deeper