Noometry

Model comparison

Mistral Nemo vs Mistral Small 3

Mistral Small 3 is the stronger model overall, scoring 31.2 to 26.4 on the Noometry Index.

Last verified . 3 shared benchmarks.

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Mistral Small 3 Mistral AI

31.2

Rank #278 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Mistral Nemo scores higher in 2 categories and Mistral Small 3 in 2 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Mistral Small 3 leads 25.1 to 12.3.
  • The biggest single-benchmark swing is GPQA Diamond: 29.9% for Mistral Nemo and 47.3% for Mistral Small 3.
  • Mistral Small 3 is cheaper at $0.05 / $0.08 per million input/output tokens, against $0.15 / $0.15 for Mistral Nemo.
  • Mistral Nemo accepts more context: 128K tokens versus 33K.

Side by side

Mistral NemoMistral Small 3
ProviderMistral AIMistral AI
Noometry Index26.431.2
Released2024-07-012025-01-30
WeightsOpenOpen
Context window128K33K
Max output128K16K
Input $ / M tokens$0.15$0.05
Output $ / M tokens$0.15$0.08
Results tracked1024

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Nemo: —, Mistral Small 3: 36.5 (#207)

BenchmarkMistral NemoMistral Small 3
BigCodeBench Instruct—45.3%
LMArena Coding—1246
BigCodeBench Complete—50.4%

Agentic & Tool Use Not comparable

Mistral Nemo: 23.5 (#125), Mistral Small 3: —

BenchmarkMistral NemoMistral Small 3
Berkeley Function Calling Leaderboard27.6%—
BALROG17.6%—

Reasoning Mistral Nemo leads

Mistral Nemo: 20.7 (#232), Mistral Small 3: 18.9 (#273)

BenchmarkMistral NemoMistral Small 3
Epoch Capabilities Index118.68127.07
Chess Puzzles—0%
LMArena Hard Prompts—1233
DTBench48.6%—
PIQA83.5%—

Math Mistral Nemo leads

Mistral Nemo: 25.5 (#268), Mistral Small 3: 16.3 (#295)

BenchmarkMistral NemoMistral Small 3
OTIS Mock AIME 2024-2025—6.7%
LMArena Math—1240
MATH Level 510.8%—
GSM8K84.2%—

Knowledge Mistral Small 3 leads

Mistral Nemo: 12.3 (#298), Mistral Small 3: 25.1 (#263)

BenchmarkMistral NemoMistral Small 3
GPQA Diamond29.9%47.3%
Confabulations—25.2%
LMArena Expert—1202
BoolQ82.5%—

Multilingual Not comparable

Mistral Nemo: —, Mistral Small 3: 37.3 (#236)

BenchmarkMistral NemoMistral Small 3
LMArena Non-English—1198
LMArena Chinese—1204
LMArena French—1203
LMArena German—1211
LMArena Japanese—1111
LMArena Korean—1188
LMArena Russian—1216

Instruction Following Not comparable

Mistral Nemo: —, Mistral Small 3: 63.7 (#229)

BenchmarkMistral NemoMistral Small 3
LMArena Instruction Following—1214

Long Context Not comparable

Mistral Nemo: —, Mistral Small 3: 37.8 (#211)

BenchmarkMistral NemoMistral Small 3
LMArena Longer Query—1246

Writing & Preference Mistral Small 3 leads

Mistral Nemo: 28.5 (#296), Mistral Small 3: 32.2 (#280)

BenchmarkMistral NemoMistral Small 3
EQ-Bench Creative Writing881707
LMArena Text—1234
LMArena Creative Writing—1195
LMArena Multi-Turn—1217

Frequently asked questions

Is Mistral Nemo better than Mistral Small 3?

Mistral Small 3 is the stronger model overall, scoring 31.2 to 26.4 on the Noometry Index.

Which is cheaper, Mistral Nemo or Mistral Small 3?

Mistral Small 3 is cheaper. It lists at $0.05 per million input tokens and $0.08 per million output tokens; Mistral Nemo lists at $0.15 and $0.15.

Which has the bigger context window?

Mistral Nemo does, with 128K tokens against 33K.

How many benchmarks do Mistral Nemo and Mistral Small 3 share?

3 benchmarks have published results for both models. Mistral Nemo has 10 scored results on Noometry and Mistral Small 3 has 24.

Related comparisons

Go deeper