Noometry

Model comparison

Mixtral 8x7B vs Nemotron 3 Super

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 27.1 on the Noometry Index.

Last verified . 15 shared benchmarks.

Mixtral 8x7B Mistral AI

27.1

Rank #334 Confirmed

Nemotron 3 Super NVIDIA

40.1

Rank #153 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Mixtral 8x7B scores higher in 0 categories and Nemotron 3 Super in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nemotron 3 Super leads 38.9 to 11.0.
  • Nemotron 3 Super is cheaper at $0.08 / $0.45 per million input/output tokens, against $0.70 / $0.70 for Mixtral 8x7B.
  • Nemotron 3 Super accepts more context: 262K tokens versus 32K.

Side by side

Mixtral 8x7BNemotron 3 Super
ProviderMistral AINVIDIA
Noometry Index27.140.1
Released2023-12-112026-03-11
WeightsOpenOpen
Context window32K262K
Max output32K131K
Input $ / M tokens$0.70$0.08
Output $ / M tokens$0.70$0.45
Results tracked3821

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Super leads

Mixtral 8x7B: 32.8 (#269), Nemotron 3 Super: 39.4 (#158)

BenchmarkMixtral 8x7BNemotron 3 Super
LMArena Coding11261403
SciCode—36%
WeirdML—38%
ALE-Bench—213.9
HumanEval+39.6%—
MBPP+49.7%—

Reasoning Too close to call

Mixtral 8x7B: 18.2 (#285), Nemotron 3 Super: 18.7 (#276)

BenchmarkMixtral 8x7BNemotron 3 Super
LMArena Hard Prompts11151386
NYT Connections (extended)—15.4%
CritPt—3.1%
DTBench49.6%—
Adversarial NLI55.2%—
Epoch Capabilities Index118.47—
ForecastBench56.3—
HellaSwag86.7%—
PIQA83.6%—
WinoGrande77.2%—

Math Nemotron 3 Super leads

Mixtral 8x7B: 18.8 (#289), Nemotron 3 Super: 39.6 (#101)

BenchmarkMixtral 8x7BNemotron 3 Super
LMArena Math11471380
MathArena Final-Answer Competitions—60.4%
Omni-MATH10.5%—
MATH Level 510%—
GSM8K74.4%—

Knowledge Nemotron 3 Super leads

Mixtral 8x7B: 11.0 (#301), Nemotron 3 Super: 38.9 (#139)

BenchmarkMixtral 8x7BNemotron 3 Super
LMArena Expert10881398
GPQA Diamond30.6%—
MMLU-Pro33.5%—
GPQA (HELM)29.6%—
ARC (AI2) Challenge87.3%—
MMLU70.6%—
OpenBookQA85.8%—
TriviaQA82.2%—

Multilingual Nemotron 3 Super leads

Mixtral 8x7B: 29.6 (#266), Nemotron 3 Super: 48.4 (#144)

BenchmarkMixtral 8x7BNemotron 3 Super
LMArena Non-English10771355
LMArena Chinese10551432
LMArena French11661405
LMArena German11141341
LMArena Russian10901336
LMArena Spanish11111417
LMArena Japanese931—
LMArena Korean968—

Instruction Following Nemotron 3 Super leads

Mixtral 8x7B: 51.0 (#297), Nemotron 3 Super: 71.2 (#154)

BenchmarkMixtral 8x7BNemotron 3 Super
LMArena Instruction Following11091347
IFEval57.5%—

Long Context Nemotron 3 Super leads

Mixtral 8x7B: 33.4 (#260), Nemotron 3 Super: 41.5 (#139)

BenchmarkMixtral 8x7BNemotron 3 Super
LMArena Longer Query11031362

Writing & Preference Nemotron 3 Super leads

Mixtral 8x7B: 34.2 (#270), Nemotron 3 Super: 55.9 (#140)

BenchmarkMixtral 8x7BNemotron 3 Super
LMArena Text11321378
LMArena Creative Writing11091317
LMArena Multi-Turn11151369
WildBench67.3%—

Frequently asked questions

Is Mixtral 8x7B better than Nemotron 3 Super?

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 27.1 on the Noometry Index.

Which is cheaper, Mixtral 8x7B or Nemotron 3 Super?

Nemotron 3 Super is cheaper. It lists at $0.08 per million input tokens and $0.45 per million output tokens; Mixtral 8x7B lists at $0.70 and $0.70.

Is Mixtral 8x7B or Nemotron 3 Super better for coding?

Nemotron 3 Super scores higher on coding benchmarks: 39.4 versus 32.8 in the Noometry coding category.

Which has the bigger context window?

Nemotron 3 Super does, with 262K tokens against 32K.

How many benchmarks do Mixtral 8x7B and Nemotron 3 Super share?

15 benchmarks have published results for both models. Mixtral 8x7B has 38 scored results on Noometry and Nemotron 3 Super has 21.

Related comparisons

Go deeper