Model comparison

Mistral 7B vs Nemotron 3 Super

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 23.0 on the Noometry Index.

Last verified . 15 shared benchmarks.

Mistral 7B Mistral AI

23.0

Rank #351 Confirmed

Nemotron 3 Super NVIDIA

40.1

Rank #153 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Mistral 7B scores higher in 0 categories and Nemotron 3 Super in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nemotron 3 Super leads 38.9 to 7.4.
  • Nemotron 3 Super is cheaper at $0.08 / $0.45 per million input/output tokens, against $0.25 / $0.25 for Mistral 7B.
  • Nemotron 3 Super accepts more context: 262K tokens versus 8K.

Side by side

Mistral 7B and Nemotron 3 Super specifications
Mistral 7BNemotron 3 Super
ProviderMistral AINVIDIA
Noometry Index23.040.1
Released2023-09-272026-03-11
WeightsOpenOpen
Context window8K262K
Max output8K131K
Input $ / M tokens$0.25$0.08
Output $ / M tokens$0.25$0.45
Results tracked3721

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Super leads

Mistral 7B: 26.4 (#326), Nemotron 3 Super: 39.4 (#158)

Coding benchmarks
BenchmarkMistral 7BNemotron 3 Super
LMArena Coding10821403
SciCode—36%
WeirdML—38%
BigCodeBench Instruct19.5%—
BigCodeBench Complete27.3%—
ALE-Bench—213.9
HumanEval+36%—
MBPP+42.1%—

Reasoning Nemotron 3 Super leads

Mistral 7B: 13.1 (#336), Nemotron 3 Super: 18.7 (#276)

Reasoning benchmarks
BenchmarkMistral 7BNemotron 3 Super
LMArena Hard Prompts10671386
NYT Connections (extended)—15.4%
CritPt—3.1%
Chess Puzzles0%—
DTBench42.5%—
Adversarial NLI47.1%—
BIG-Bench Hard56.1%—
Epoch Capabilities Index112.21—
HellaSwag81%—
PIQA83%—
WinoGrande75.3%—

Math Nemotron 3 Super leads

Mistral 7B: 8.1 (#325), Nemotron 3 Super: 39.6 (#101)

Math benchmarks
BenchmarkMistral 7BNemotron 3 Super
LMArena Math10851380
MathArena Final-Answer Competitions—60.4%
OTIS Mock AIME 2024-20250.3%—
MATH Level 53.7%—
GSM8K54.4%—

Knowledge Nemotron 3 Super leads

Mistral 7B: 7.4 (#311), Nemotron 3 Super: 38.9 (#139)

Knowledge benchmarks
BenchmarkMistral 7BNemotron 3 Super
LMArena Expert10361398
GPQA Diamond15.2%—
ARC (AI2) Challenge78.6%—
BoolQ87.4%—
MMLU62.5%—
OpenBookQA79.8%—
TriviaQA75.2%—

Multilingual Nemotron 3 Super leads

Mistral 7B: 25.8 (#283), Nemotron 3 Super: 48.4 (#144)

Multilingual benchmarks
BenchmarkMistral 7BNemotron 3 Super
LMArena Non-English10121355
LMArena Chinese10091432
LMArena French10371405
LMArena German9871341
LMArena Russian10181336
LMArena Spanish10261417
LMArena Japanese878—

Instruction Following Nemotron 3 Super leads

Mistral 7B: 54.2 (#280), Nemotron 3 Super: 71.2 (#154)

Instruction Following benchmarks
BenchmarkMistral 7BNemotron 3 Super
LMArena Instruction Following10601347

Long Context Nemotron 3 Super leads

Mistral 7B: 32.2 (#271), Nemotron 3 Super: 41.5 (#139)

Long Context benchmarks
BenchmarkMistral 7BNemotron 3 Super
LMArena Longer Query10601362

Writing & Preference Nemotron 3 Super leads

Mistral 7B: 30.7 (#286), Nemotron 3 Super: 55.9 (#140)

Writing & Preference benchmarks
BenchmarkMistral 7BNemotron 3 Super
LMArena Text10901378
LMArena Creative Writing10681317
LMArena Multi-Turn10621369

Frequently asked questions

Is Mistral 7B better than Nemotron 3 Super?

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 23.0 on the Noometry Index.

Which is cheaper, Mistral 7B or Nemotron 3 Super?

Nemotron 3 Super is cheaper. It lists at $0.08 per million input tokens and $0.45 per million output tokens; Mistral 7B lists at $0.25 and $0.25.

Is Mistral 7B or Nemotron 3 Super better for coding?

Nemotron 3 Super scores higher on coding benchmarks: 39.4 versus 26.4 in the Noometry coding category.

Which has the bigger context window?

Nemotron 3 Super does, with 262K tokens against 8K.

How many benchmarks do Mistral 7B and Nemotron 3 Super share?

15 benchmarks have published results for both models. Mistral 7B has 37 scored results on Noometry and Nemotron 3 Super has 21.

Related comparisons

Go deeper