Model comparison

Mistral Medium vs Nemotron 3 Super

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 36.3 on the Noometry Index.

Last verified . 19 shared benchmarks.

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Nemotron 3 Super NVIDIA

40.1

Rank #153 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Mistral Medium scores higher in 5 categories and Nemotron 3 Super in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nemotron 3 Super leads 38.9 to 25.0.
  • The biggest single-benchmark swing is WeirdML: 43.7% for Mistral Medium and 38% for Nemotron 3 Super.
  • Nemotron 3 Super is cheaper at $0.08 / $0.45 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium.

Side by side

Mistral Medium and Nemotron 3 Super specifications
Mistral MediumNemotron 3 Super
ProviderMistral AINVIDIA
Noometry Index36.340.1
Released2023-12-112026-03-11
WeightsOpenOpen
Context window262K262K
Max output262K131K
Input $ / M tokens$1.50$0.08
Output $ / M tokens$7.50$0.45
Results tracked3621

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Super leads

Mistral Medium: 34.2 (#243), Nemotron 3 Super: 39.4 (#158)

Coding benchmarks
BenchmarkMistral MediumNemotron 3 Super
SciCode40.2%36%
WeirdML43.7%38%
LMArena Coding14341403
ALE-Bench763.98213.9
FrontierCode8%—

Agentic & Tool Use Not comparable

Mistral Medium: 28.3 (#90), Nemotron 3 Super: —

Agentic & Tool Use benchmarks
BenchmarkMistral MediumNemotron 3 Super
Berkeley Function Calling Leaderboard37.7%—

Reasoning Mistral Medium leads

Mistral Medium: 24.0 (#167), Nemotron 3 Super: 18.7 (#276)

Reasoning benchmarks
BenchmarkMistral MediumNemotron 3 Super
CritPt0%3.1%
LMArena Hard Prompts14261386
Kagi LLM Benchmark50%—
NYT Connections (extended)—15.4%
DTBench75.5%—
LMCA26.1%—
Surface Evolver Bench26.9%—

Math Nemotron 3 Super leads

Mistral Medium: 28.1 (#245), Nemotron 3 Super: 39.6 (#101)

Math benchmarks
BenchmarkMistral MediumNemotron 3 Super
LMArena Math14081380
MathArena Final-Answer Competitions—60.4%
OTIS Mock AIME 2024-202532.2%—
ProofBench9%—
MATH Level 581.6%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Nemotron 3 Super leads

Mistral Medium: 25.0 (#265), Nemotron 3 Super: 38.9 (#139)

Knowledge benchmarks
BenchmarkMistral MediumNemotron 3 Super
LMArena Expert14081398
GPQA Diamond59.5%—
Humanity's Last Exam4.5%—
Vectara Hallucination Rate22.7%—

Multimodal Not comparable

Mistral Medium: 35.3 (#88), Nemotron 3 Super: —

Multimodal benchmarks
BenchmarkMistral MediumNemotron 3 Super
LMArena Vision1172—

Multilingual Mistral Medium leads

Mistral Medium: 52.1 (#91), Nemotron 3 Super: 48.4 (#144)

Multilingual benchmarks
BenchmarkMistral MediumNemotron 3 Super
LMArena Non-English14081355
LMArena Chinese14471432
LMArena French14591405
LMArena German14321341
LMArena Russian14111336
LMArena Spanish14331417
LMArena Japanese1378—
LMArena Korean1380—

Instruction Following Mistral Medium leads

Mistral Medium: 73.7 (#116), Nemotron 3 Super: 71.2 (#154)

Instruction Following benchmarks
BenchmarkMistral MediumNemotron 3 Super
LMArena Instruction Following13981347

Long Context Mistral Medium leads

Mistral Medium: 42.9 (#114), Nemotron 3 Super: 41.5 (#139)

Long Context benchmarks
BenchmarkMistral MediumNemotron 3 Super
LMArena Longer Query14061362

Writing & Preference Mistral Medium leads

Mistral Medium: 60.0 (#103), Nemotron 3 Super: 55.9 (#140)

Writing & Preference benchmarks
BenchmarkMistral MediumNemotron 3 Super
LMArena Text14241378
LMArena Creative Writing13911317
LMArena Multi-Turn14181369
Short-Story Creative Writing77.3%—

Frequently asked questions

Is Mistral Medium better than Nemotron 3 Super?

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 36.3 on the Noometry Index.

Which is cheaper, Mistral Medium or Nemotron 3 Super?

Nemotron 3 Super is cheaper. It lists at $0.08 per million input tokens and $0.45 per million output tokens; Mistral Medium lists at $1.50 and $7.50.

Is Mistral Medium or Nemotron 3 Super better for coding?

Nemotron 3 Super scores higher on coding benchmarks: 39.4 versus 34.2 in the Noometry coding category.

Which has the bigger context window?

Both accept 262K tokens.

How many benchmarks do Mistral Medium and Nemotron 3 Super share?

19 benchmarks have published results for both models. Mistral Medium has 36 scored results on Noometry and Nemotron 3 Super has 21.

Related comparisons

Go deeper