Noometry

Model comparison

Mistral Small 3.1 vs Nemotron 3 Ultra

Nemotron 3 Ultra is the stronger model overall, scoring 42.5 to 31.7 on the Noometry Index. Mistral Small 3.1 costs 2.6× less per token, which makes it the better buy when Nemotron 3 Ultra's lead doesn't matter for your workload.

Last verified . 21 shared benchmarks.

Mistral Small 3.1 Mistral AI

31.7

Rank #269 Confirmed

Nemotron 3 Ultra NVIDIA

42.5

Rank #113 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Mistral Small 3.1 scores higher in 1 category and Nemotron 3 Ultra in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nemotron 3 Ultra leads 52.5 to 22.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 3.9% for Mistral Small 3.1 and 86.7% for Nemotron 3 Ultra.
  • Mistral Small 3.1 is cheaper at $0.35 / $0.56 per million input/output tokens, against $0.60 / $2.40 for Nemotron 3 Ultra.
  • Nemotron 3 Ultra accepts more context: 262K tokens versus 128K.

Side by side

Mistral Small 3.1Nemotron 3 Ultra
ProviderMistral AINVIDIA
Noometry Index31.742.5
Released2025-03-172026-06-04
WeightsOpenOpen
Context window128K262K
Max output102K128K
Input $ / M tokens$0.35$0.60
Output $ / M tokens$0.56$2.40
Results tracked2830

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Mistral Small 3.1: 38.3 (#179), Nemotron 3 Ultra: 38.1 (#182)

BenchmarkMistral Small 3.1Nemotron 3 Ultra
LMArena Coding13091468
FrontierCode—13.6%
SciCode—40.3%
WeirdML—43.5%

Agentic & Tool Use Not comparable

Mistral Small 3.1: —, Nemotron 3 Ultra: 23.4 (#126)

BenchmarkMistral Small 3.1Nemotron 3 Ultra
APEX-Agents—22.7%

Reasoning Nemotron 3 Ultra leads

Mistral Small 3.1: 19.7 (#254), Nemotron 3 Ultra: 31.0 (#82)

BenchmarkMistral Small 3.1Nemotron 3 Ultra
Chess Puzzles1%12%
LMArena Hard Prompts12781452
Epoch Capabilities Index127.48146.17
CritPt—3.1%
Mystery Game Puzzles—20%
DTBench—90.1%
LMCA—36.9%

Math Nemotron 3 Ultra leads

Mistral Small 3.1: 14.7 (#301), Nemotron 3 Ultra: 35.3 (#187)

BenchmarkMistral Small 3.1Nemotron 3 Ultra
OTIS Mock AIME 2024-20253.9%86.7%
LMArena Math12621457
ProofBench—2%
Omni-MATH24.8%—

Knowledge Nemotron 3 Ultra leads

Mistral Small 3.1: 22.6 (#271), Nemotron 3 Ultra: 52.5 (#61)

BenchmarkMistral Small 3.1Nemotron 3 Ultra
GPQA Diamond41.9%85.4%
LMArena Expert12571472
MMLU-Pro61%—
GPQA (HELM)39.2%—

Multimodal Not comparable

Mistral Small 3.1: 33.2 (#99), Nemotron 3 Ultra: —

BenchmarkMistral Small 3.1Nemotron 3 Ultra
LMArena Vision1136—

Multilingual Nemotron 3 Ultra leads

Mistral Small 3.1: 41.2 (#209), Nemotron 3 Ultra: 53.5 (#64)

BenchmarkMistral Small 3.1Nemotron 3 Ultra
LMArena Non-English12551427
LMArena Chinese12531497
LMArena French12731472
LMArena German12661471
LMArena Korean12061386
LMArena Russian12631417
LMArena Spanish12831454
LMArena Japanese1208—

Instruction Following Nemotron 3 Ultra leads

Mistral Small 3.1: 63.6 (#230), Nemotron 3 Ultra: 74.7 (#88)

BenchmarkMistral Small 3.1Nemotron 3 Ultra
LMArena Instruction Following12641418
IFEval75%—

Long Context Nemotron 3 Ultra leads

Mistral Small 3.1: 39.5 (#178), Nemotron 3 Ultra: 43.9 (#81)

BenchmarkMistral Small 3.1Nemotron 3 Ultra
LMArena Longer Query12991437

Writing & Preference Nemotron 3 Ultra leads

Mistral Small 3.1: 37.0 (#259), Nemotron 3 Ultra: 66.3 (#36)

BenchmarkMistral Small 3.1Nemotron 3 Ultra
LMArena Text12771445
LMArena Creative Writing12531398
EQ-Bench Creative Writing7611692
LMArena Multi-Turn12701411
WildBench78.8%—

Frequently asked questions

Is Mistral Small 3.1 better than Nemotron 3 Ultra?

Nemotron 3 Ultra is the stronger model overall, scoring 42.5 to 31.7 on the Noometry Index. Mistral Small 3.1 costs 2.6× less per token, which makes it the better buy when Nemotron 3 Ultra's lead doesn't matter for your workload.

Which is cheaper, Mistral Small 3.1 or Nemotron 3 Ultra?

Mistral Small 3.1 is cheaper. It lists at $0.35 per million input tokens and $0.56 per million output tokens; Nemotron 3 Ultra lists at $0.60 and $2.40.

Is Mistral Small 3.1 or Nemotron 3 Ultra better for coding?

They score almost the same on coding (38.3 vs 38.1); test both on your own repository before choosing.

Which has the bigger context window?

Nemotron 3 Ultra does, with 262K tokens against 128K.

How many benchmarks do Mistral Small 3.1 and Nemotron 3 Ultra share?

21 benchmarks have published results for both models. Mistral Small 3.1 has 28 scored results on Noometry and Nemotron 3 Ultra has 30.

Related comparisons

Go deeper