Noometry

Model comparison

Mistral Small 3.1 vs Nemotron 4 340b Instruct

Nemotron 4 340b Instruct is the stronger model overall, scoring 35.3 to 31.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Mistral Small 3.1 Mistral AI

31.4

Rank #263 Confirmed

Nemotron 4 340b Instruct NVIDIA

35.3

Rank #218 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Mistral Small 3.1 scores higher in 4 categories and Nemotron 4 340b Instruct in 4 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nemotron 4 340b Instruct leads 31.7 to 13.7.

Side by side

Mistral Small 3.1Nemotron 4 340b Instruct
ProviderMistral AINVIDIA
Noometry Index31.435.3
Released2025-03-172024-06-14
WeightsOpenOpen
Context window128K—
Max output102K—
Input $ / M tokens$0.35—
Output $ / M tokens$0.56—
Results tracked2817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3.1 leads

Mistral Small 3.1: 37.7 (#175), Nemotron 4 340b Instruct: 34.6 (#223)

BenchmarkMistral Small 3.1Nemotron 4 340b Instruct
LMArena Coding13091209

Reasoning Nemotron 4 340b Instruct leads

Mistral Small 3.1: 18.9 (#249), Nemotron 4 340b Instruct: 22.4 (#180)

BenchmarkMistral Small 3.1Nemotron 4 340b Instruct
LMArena Hard Prompts12781202
Chess Puzzles1%—
Epoch Capabilities Index127.48—

Math Nemotron 4 340b Instruct leads

Mistral Small 3.1: 13.7 (#295), Nemotron 4 340b Instruct: 31.7 (#193)

BenchmarkMistral Small 3.1Nemotron 4 340b Instruct
LMArena Math12611216
OTIS Mock AIME 2024-20253.9%—
Omni-MATH24.8%—

Knowledge Nemotron 4 340b Instruct leads

Mistral Small 3.1: 22.6 (#266), Nemotron 4 340b Instruct: 31.4 (#212)

BenchmarkMistral Small 3.1Nemotron 4 340b Instruct
LMArena Expert12581171
GPQA Diamond41.9%—
MMLU-Pro61%—
GPQA (HELM)39.2%—

Multimodal Not comparable

Mistral Small 3.1: 32.6 (#93), Nemotron 4 340b Instruct: —

BenchmarkMistral Small 3.1Nemotron 4 340b Instruct
LMArena Vision1136—

Multilingual Mistral Small 3.1 leads

Mistral Small 3.1: 41.4 (#204), Nemotron 4 340b Instruct: 38.0 (#228)

BenchmarkMistral Small 3.1Nemotron 4 340b Instruct
LMArena Non-English12551206
LMArena Chinese12541214
LMArena French12701196
LMArena German12661192
LMArena Japanese12101128
LMArena Korean12061148
LMArena Russian12631219
LMArena Spanish12831195

Instruction Following Too close to call

Mistral Small 3.1: 63.8 (#225), Nemotron 4 340b Instruct: 63.3 (#227)

BenchmarkMistral Small 3.1Nemotron 4 340b Instruct
LMArena Instruction Following12641203
IFEval75%—

Long Context Mistral Small 3.1 leads

Mistral Small 3.1: 39.5 (#172), Nemotron 4 340b Instruct: 37.1 (#216)

BenchmarkMistral Small 3.1Nemotron 4 340b Instruct
LMArena Longer Query13001225

Writing & Preference Nemotron 4 340b Instruct leads

Mistral Small 3.1: 37.2 (#254), Nemotron 4 340b Instruct: 42.9 (#229)

BenchmarkMistral Small 3.1Nemotron 4 340b Instruct
LMArena Text12781225
LMArena Creative Writing12531203
LMArena Multi-Turn12701214
EQ-Bench Creative Writing761—
WildBench78.8%—

Frequently asked questions

Is Mistral Small 3.1 better than Nemotron 4 340b Instruct?

Nemotron 4 340b Instruct is the stronger model overall, scoring 35.3 to 31.4 on the Noometry Index.

Is Mistral Small 3.1 or Nemotron 4 340b Instruct better for coding?

Mistral Small 3.1 scores higher on coding benchmarks: 37.7 versus 34.6 in the Noometry coding category.

How many benchmarks do Mistral Small 3.1 and Nemotron 4 340b Instruct share?

17 benchmarks have published results for both models. Mistral Small 3.1 has 28 scored results on Noometry and Nemotron 4 340b Instruct has 17.

Related comparisons

Go deeper