Model comparison

Gemini 1.0 Pro Vision vs Mistral Nemo

Mistral Nemo has enough public results to be ranked (#337); Gemini 1.0 Pro Vision does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Gemini 1.0 Pro Vision and Mistral Nemo specifications
Gemini 1.0 Pro VisionMistral Nemo
ProviderGoogleMistral AI
Noometry Index—26.4
Released2024-01-042024-07-01
WeightsProprietaryOpen
Context window—128K
Max output—128K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.15
Results tracked110

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Gemini 1.0 Pro Vision: —, Mistral Nemo: 23.5 (#125)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.0 Pro VisionMistral Nemo
Berkeley Function Calling Leaderboard—27.6%
BALROG—17.6%

Reasoning Not comparable

Gemini 1.0 Pro Vision: —, Mistral Nemo: 20.7 (#232)

Reasoning benchmarks
BenchmarkGemini 1.0 Pro VisionMistral Nemo
DTBench—48.6%
Epoch Capabilities Index—118.68
PIQA—83.5%

Math Not comparable

Gemini 1.0 Pro Vision: —, Mistral Nemo: 25.5 (#268)

Math benchmarks
BenchmarkGemini 1.0 Pro VisionMistral Nemo
MATH Level 5—10.8%
GSM8K—84.2%

Knowledge Not comparable

Gemini 1.0 Pro Vision: —, Mistral Nemo: 12.3 (#298)

Knowledge benchmarks
BenchmarkGemini 1.0 Pro VisionMistral Nemo
GPQA Diamond—29.9%
BoolQ—82.5%

Multimodal Not comparable

Gemini 1.0 Pro Vision: —, Mistral Nemo: —

Multimodal benchmarks
BenchmarkGemini 1.0 Pro VisionMistral Nemo
ScienceQA79.7%—

Writing & Preference Not comparable

Gemini 1.0 Pro Vision: —, Mistral Nemo: 28.5 (#296)

Writing & Preference benchmarks
BenchmarkGemini 1.0 Pro VisionMistral Nemo
EQ-Bench Creative Writing—881

Frequently asked questions

Is Gemini 1.0 Pro Vision better than Mistral Nemo?

Mistral Nemo has enough public results to be ranked (#337); Gemini 1.0 Pro Vision does not yet, so treat this comparison as directional.

How many benchmarks do Gemini 1.0 Pro Vision and Mistral Nemo share?

0 benchmarks have published results for both models. Gemini 1.0 Pro Vision has 1 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper