Noometry

Model comparison

Gemma 1.1 7b IT vs Mistral Medium 3.1

Gemma 1.1 7b IT and Mistral Medium 3.1 score almost the same on the Noometry Index (31.3 vs 31.9), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Summary

  • The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 30.4.
  • Gemma 1.1 7b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 1.1 7b ITMistral Medium 3.1
ProviderGoogleMistral AI
Noometry Index31.331.9
Released——
WeightsOpenProprietary
Context window—131K
Max output—105K
Input $ / M tokens—$0.40
Output $ / M tokens—$2
Results tracked193

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 1.1 7b IT: 31.5 (#284), Mistral Medium 3.1: —

BenchmarkGemma 1.1 7b ITMistral Medium 3.1
LMArena Coding1084—
HumanEval+35.4%—
MBPP+45%—

Reasoning Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 20.5 (#238), Mistral Medium 3.1: 10.6 (#341)

BenchmarkGemma 1.1 7b ITMistral Medium 3.1
NYT Connections (extended)—6.5%
Thematic Generalization—20.3%
LMArena Hard Prompts1071—

Math Not comparable

Gemma 1.1 7b IT: 32.0 (#220), Mistral Medium 3.1: —

BenchmarkGemma 1.1 7b ITMistral Medium 3.1
LMArena Math1107—

Knowledge Not comparable

Gemma 1.1 7b IT: 28.3 (#247), Mistral Medium 3.1: —

BenchmarkGemma 1.1 7b ITMistral Medium 3.1
LMArena Expert1039—

Multilingual Not comparable

Gemma 1.1 7b IT: 28.1 (#273), Mistral Medium 3.1: —

BenchmarkGemma 1.1 7b ITMistral Medium 3.1
LMArena Non-English1052—
LMArena Chinese1061—
LMArena French1065—
LMArena German1054—
LMArena Japanese971—
LMArena Korean988—
LMArena Russian1046—
LMArena Spanish1049—

Instruction Following Not comparable

Gemma 1.1 7b IT: 54.0 (#283), Mistral Medium 3.1: —

BenchmarkGemma 1.1 7b ITMistral Medium 3.1
LMArena Instruction Following1057—

Long Context Not comparable

Gemma 1.1 7b IT: 32.1 (#272), Mistral Medium 3.1: —

BenchmarkGemma 1.1 7b ITMistral Medium 3.1
LMArena Longer Query1056—

Writing & Preference Mistral Medium 3.1 leads

Gemma 1.1 7b IT: 30.4 (#288), Mistral Medium 3.1: 55.5 (#145)

BenchmarkGemma 1.1 7b ITMistral Medium 3.1
LMArena Text1094—
LMArena Creative Writing1060—
EQ-Bench Creative Writing—1476
LMArena Multi-Turn1040—

Frequently asked questions

Is Gemma 1.1 7b IT better than Mistral Medium 3.1?

Gemma 1.1 7b IT and Mistral Medium 3.1 score almost the same on the Noometry Index (31.3 vs 31.9), so choose on price, context window or the category you care about most.

How many benchmarks do Gemma 1.1 7b IT and Mistral Medium 3.1 share?

0 benchmarks have published results for both models. Gemma 1.1 7b IT has 19 scored results on Noometry and Mistral Medium 3.1 has 3.

Related comparisons

Go deeper