Model comparison

Mistral Nemo vs Pixtral Large

Pixtral Large is the stronger model overall, scoring 32.2 to 26.4 on the Noometry Index. Mistral Nemo costs 20× less per token, which makes it the better buy when Pixtral Large's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • They share 1 benchmark with published results for both. Mistral Nemo scores higher in 0 categories and Pixtral Large in 2 categories; one gap is clear of the uncertainty.
  • The widest gap is in writing & preference, where Pixtral Large leads 32.9 to 28.5.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $2 / $6 for Pixtral Large.

Side by side

Mistral Nemo and Pixtral Large specifications
Mistral NemoPixtral Large
ProviderMistral AIMistral AI
Noometry Index26.432.2
Released2024-07-012024-11-01
WeightsOpenOpen
Context window128K128K
Max output128K128K
Input $ / M tokens$0.15$2
Output $ / M tokens$0.15$6
Results tracked103

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Agentic & Tool Use Not comparable

Mistral Nemo: 23.5 (#125), Pixtral Large: —

Agentic & Tool Use benchmarks
BenchmarkMistral NemoPixtral Large
Berkeley Function Calling Leaderboard27.6%—
BALROG17.6%—

Reasoning Too close to call

Mistral Nemo: 20.7 (#232), Pixtral Large: 21.7 (#218)

Reasoning benchmarks
BenchmarkMistral NemoPixtral Large
EnigmaEval—0.8%
DTBench48.6%—
Epoch Capabilities Index118.68—
PIQA83.5%—

Math Not comparable

Mistral Nemo: 25.5 (#268), Pixtral Large: —

Math benchmarks
BenchmarkMistral NemoPixtral Large
MATH Level 510.8%—
GSM8K84.2%—

Knowledge Not comparable

Mistral Nemo: 12.3 (#298), Pixtral Large: —

Knowledge benchmarks
BenchmarkMistral NemoPixtral Large
GPQA Diamond29.9%—
BoolQ82.5%—

Multimodal Not comparable

Mistral Nemo: —, Pixtral Large: 30.6 (#111)

Multimodal benchmarks
BenchmarkMistral NemoPixtral Large
LMArena Vision—1089

Writing & Preference Pixtral Large leads

Mistral Nemo: 28.5 (#296), Pixtral Large: 32.9 (#278)

Writing & Preference benchmarks
BenchmarkMistral NemoPixtral Large
EQ-Bench Creative Writing881988

Frequently asked questions

Is Mistral Nemo better than Pixtral Large?

Pixtral Large is the stronger model overall, scoring 32.2 to 26.4 on the Noometry Index. Mistral Nemo costs 20× less per token, which makes it the better buy when Pixtral Large's lead doesn't matter for your workload.

Which is cheaper, Mistral Nemo or Pixtral Large?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Pixtral Large lists at $2 and $6.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do Mistral Nemo and Pixtral Large share?

1 benchmark has published results for both models. Mistral Nemo has 10 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper