Model comparison

Mistral Medium 3.1 vs Palm 2

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 30.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Palm 2 Google

30.0

Rank #298 Confirmed

Summary

  • The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 25.6.

Side by side

Mistral Medium 3.1 and Palm 2 specifications
Mistral Medium 3.1Palm 2
ProviderMistral AIGoogle
Noometry Index31.930.0
Released——
WeightsProprietaryProprietary
Context window131K—
Max output105K—
Input $ / M tokens$0.40—
Output $ / M tokens$2—
Results tracked310

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Medium 3.1: —, Palm 2: 29.0 (#311)

Coding benchmarks
BenchmarkMistral Medium 3.1Palm 2
LMArena Coding—994

Reasoning Palm 2 leads

Mistral Medium 3.1: 10.6 (#341), Palm 2: 19.1 (#271)

Reasoning benchmarks
BenchmarkMistral Medium 3.1Palm 2
NYT Connections (extended)6.5%—
Thematic Generalization20.3%—
LMArena Hard Prompts—1005

Math Not comparable

Mistral Medium 3.1: —, Palm 2: 30.8 (#231)

Math benchmarks
BenchmarkMistral Medium 3.1Palm 2
LMArena Math—1049

Multilingual Not comparable

Mistral Medium 3.1: —, Palm 2: 20.9 (#295)

Multilingual benchmarks
BenchmarkMistral Medium 3.1Palm 2
LMArena Non-English—916
LMArena Chinese—887

Instruction Following Not comparable

Mistral Medium 3.1: —, Palm 2: 51.0 (#296)

Instruction Following benchmarks
BenchmarkMistral Medium 3.1Palm 2
LMArena Instruction Following—1010

Long Context Not comparable

Mistral Medium 3.1: —, Palm 2: 30.8 (#285)

Long Context benchmarks
BenchmarkMistral Medium 3.1Palm 2
LMArena Longer Query—1010

Writing & Preference Mistral Medium 3.1 leads

Mistral Medium 3.1: 55.5 (#145), Palm 2: 25.6 (#304)

Writing & Preference benchmarks
BenchmarkMistral Medium 3.1Palm 2
LMArena Text—1027
LMArena Creative Writing—991
EQ-Bench Creative Writing1476—
LMArena Multi-Turn—994

Frequently asked questions

Is Mistral Medium 3.1 better than Palm 2?

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 30.0 on the Noometry Index.

How many benchmarks do Mistral Medium 3.1 and Palm 2 share?

0 benchmarks have published results for both models. Mistral Medium 3.1 has 3 scored results on Noometry and Palm 2 has 10.

Related comparisons

Go deeper