Noometry

Model comparison

Mixtral 8x7B vs Nova Premier 1.0

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 27.1 on the Noometry Index. Mixtral 8x7B costs 7.1× less per token, which makes it the better buy when Nova Premier 1.0's lead doesn't matter for your workload.

Last verified . 5 shared benchmarks.

Mixtral 8x7B Mistral AI

27.1

Rank #334 Confirmed

Nova Premier 1.0 Amazon

38.3

Rank #189 Confirmed

Summary

  • They share 5 benchmarks with published results for both. Mixtral 8x7B scores higher in 0 categories and Nova Premier 1.0 in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nova Premier 1.0 leads 35.8 to 11.0.
  • The biggest single-benchmark swing is MMLU-Pro: 33.5% for Mixtral 8x7B and 72.6% for Nova Premier 1.0.
  • Mixtral 8x7B is cheaper at $0.70 / $0.70 per million input/output tokens, against $2.50 / $12.50 for Nova Premier 1.0.
  • Nova Premier 1.0 accepts more context: 1M tokens versus 32K.
  • Mixtral 8x7B has downloadable open weights; the other is API-only.

Side by side

Mixtral 8x7BNova Premier 1.0
ProviderMistral AIAmazon
Noometry Index27.138.3
Released2023-12-112025-04-30
WeightsOpenProprietary
Context window32K1M
Max output32K10K
Input $ / M tokens$0.70$2.50
Output $ / M tokens$0.70$12.50
Results tracked386

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mixtral 8x7B: 32.8 (#269), Nova Premier 1.0: —

BenchmarkMixtral 8x7BNova Premier 1.0
LMArena Coding1126—
HumanEval+39.6%—
MBPP+49.7%—

Reasoning Nova Premier 1.0 leads

Mixtral 8x7B: 18.2 (#285), Nova Premier 1.0: 23.0 (#185)

BenchmarkMixtral 8x7BNova Premier 1.0
Kagi LLM Benchmark—44.8%
LMArena Hard Prompts1115—
DTBench49.6%—
Adversarial NLI55.2%—
Epoch Capabilities Index118.47—
ForecastBench56.3—
HellaSwag86.7%—
PIQA83.6%—
WinoGrande77.2%—

Math Nova Premier 1.0 leads

Mixtral 8x7B: 18.8 (#289), Nova Premier 1.0: 33.8 (#199)

BenchmarkMixtral 8x7BNova Premier 1.0
Omni-MATH10.5%35%
LMArena Math1147—
MATH Level 510%—
GSM8K74.4%—

Knowledge Nova Premier 1.0 leads

Mixtral 8x7B: 11.0 (#301), Nova Premier 1.0: 35.8 (#180)

BenchmarkMixtral 8x7BNova Premier 1.0
MMLU-Pro33.5%72.6%
GPQA (HELM)29.6%51.8%
GPQA Diamond30.6%—
LMArena Expert1088—
ARC (AI2) Challenge87.3%—
MMLU70.6%—
OpenBookQA85.8%—
TriviaQA82.2%—

Multilingual Not comparable

Mixtral 8x7B: 29.6 (#266), Nova Premier 1.0: —

BenchmarkMixtral 8x7BNova Premier 1.0
LMArena Non-English1077—
LMArena Chinese1055—
LMArena French1166—
LMArena German1114—
LMArena Japanese931—
LMArena Korean968—
LMArena Russian1090—
LMArena Spanish1111—

Instruction Following Nova Premier 1.0 leads

Mixtral 8x7B: 51.0 (#297), Nova Premier 1.0: 66.8 (#204)

BenchmarkMixtral 8x7BNova Premier 1.0
IFEval57.5%80.3%
LMArena Instruction Following1109—

Long Context Not comparable

Mixtral 8x7B: 33.4 (#260), Nova Premier 1.0: —

BenchmarkMixtral 8x7BNova Premier 1.0
LMArena Longer Query1103—

Writing & Preference Nova Premier 1.0 leads

Mixtral 8x7B: 34.2 (#270), Nova Premier 1.0: 51.0 (#178)

BenchmarkMixtral 8x7BNova Premier 1.0
WildBench67.3%78.8%
LMArena Text1132—
LMArena Creative Writing1109—
LMArena Multi-Turn1115—

Frequently asked questions

Is Mixtral 8x7B better than Nova Premier 1.0?

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 27.1 on the Noometry Index. Mixtral 8x7B costs 7.1× less per token, which makes it the better buy when Nova Premier 1.0's lead doesn't matter for your workload.

Which is cheaper, Mixtral 8x7B or Nova Premier 1.0?

Mixtral 8x7B is cheaper. It lists at $0.70 per million input tokens and $0.70 per million output tokens; Nova Premier 1.0 lists at $2.50 and $12.50.

Which has the bigger context window?

Nova Premier 1.0 does, with 1M tokens against 32K.

How many benchmarks do Mixtral 8x7B and Nova Premier 1.0 share?

5 benchmarks have published results for both models. Mixtral 8x7B has 38 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper