Model comparison

Gemini 1.0 Pro vs Mistral Large 4

Mistral Large 4 is the stronger model overall, scoring 43.1 to 27.3 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Mistral Large 4 Mistral AI

43.1

Rank #99 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Mistral Large 4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Mistral Large 4 leads 40.4 to 9.3.

Side by side

Gemini 1.0 Pro and Mistral Large 4 specifications
Gemini 1.0 ProMistral Large 4
ProviderGoogleMistral AI
Noometry Index27.343.1
Released2023-12-132026-10-06
WeightsProprietaryProprietary
Context window—1.05M
Max output—262K
Input $ / M tokens—$0.68
Output $ / M tokens—$2.09
Results tracked2415

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large 4 leads

Gemini 1.0 Pro: 32.2 (#275), Mistral Large 4: 48.6 (#57)

Coding benchmarks
BenchmarkGemini 1.0 ProMistral Large 4
LMArena Coding11081475
LMArena WebDev—1541
HumanEval+55.5%—
MBPP+61.4%—

Reasoning Mistral Large 4 leads

Gemini 1.0 Pro: 17.1 (#296), Mistral Large 4: 22.5 (#192)

Reasoning benchmarks
BenchmarkGemini 1.0 ProMistral Large 4
LMArena Hard Prompts11091444
NYT Connections (extended)—27.4%
DTBench45.9%—
Epoch Capabilities Index117.04—

Math Mistral Large 4 leads

Gemini 1.0 Pro: 9.3 (#321), Mistral Large 4: 40.4 (#91)

Math benchmarks
BenchmarkGemini 1.0 ProMistral Large 4
LMArena Math11321488
OTIS Mock AIME 2024-20251.1%—
MATH Level 511.2%—

Knowledge Mistral Large 4 leads

Gemini 1.0 Pro: 15.6 (#291), Mistral Large 4: 36.6 (#166)

Knowledge benchmarks
BenchmarkGemini 1.0 ProMistral Large 4
LMArena Expert10591447
GPQA Diamond34%—
SimpleQA Verified—20%
MMLU70%—

Multilingual Mistral Large 4 leads

Gemini 1.0 Pro: 33.4 (#252), Mistral Large 4: 52.6 (#82)

Multilingual benchmarks
BenchmarkGemini 1.0 ProMistral Large 4
LMArena Non-English11381415
LMArena Chinese11241491
LMArena Russian11861414
LMArena French1145—
LMArena German1125—
LMArena Japanese1023—
LMArena Spanish1119—

Instruction Following Mistral Large 4 leads

Gemini 1.0 Pro: 57.6 (#267), Mistral Large 4: 75.0 (#76)

Instruction Following benchmarks
BenchmarkGemini 1.0 ProMistral Large 4
LMArena Instruction Following11141424

Long Context Mistral Large 4 leads

Gemini 1.0 Pro: 34.3 (#249), Mistral Large 4: 43.6 (#89)

Long Context benchmarks
BenchmarkGemini 1.0 ProMistral Large 4
LMArena Longer Query11321429

Writing & Preference Mistral Large 4 leads

Gemini 1.0 Pro: 36.0 (#264), Mistral Large 4: 60.4 (#97)

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProMistral Large 4
LMArena Text11491427
LMArena Creative Writing11311361
LMArena Multi-Turn11391424

Frequently asked questions

Is Gemini 1.0 Pro better than Mistral Large 4?

Mistral Large 4 is the stronger model overall, scoring 43.1 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or Mistral Large 4 better for coding?

Mistral Large 4 scores higher on coding benchmarks: 48.6 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Mistral Large 4 share?

12 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Mistral Large 4 has 15.

Related comparisons

Go deeper