Model comparison

Mistral vs Nova Premier 1.0

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 29.9 on the Noometry Index.

Last verified . 5 shared benchmarks.

Mistral Mistral AI

29.9

Rank #303 Confirmed

Nova Premier 1.0 Amazon

38.3

Rank #189 Confirmed

Summary

  • They share 5 benchmarks with published results for both. Mistral scores higher in 0 categories and Nova Premier 1.0 in 5 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nova Premier 1.0 leads 35.8 to 16.6.
  • The biggest single-benchmark swing is MMLU-Pro: 27.7% for Mistral and 72.6% for Nova Premier 1.0.

Side by side

Mistral and Nova Premier 1.0 specifications
MistralNova Premier 1.0
ProviderMistral AIAmazon
Noometry Index29.938.3
Released—2025-04-30
WeightsProprietaryProprietary
Context window—1M
Max output—10K
Input $ / M tokens—$2.50
Output $ / M tokens—$12.50
Results tracked226

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral: 33.8 (#250), Nova Premier 1.0: —

Coding benchmarks
BenchmarkMistralNova Premier 1.0
LMArena Coding1162—

Reasoning Too close to call

Mistral: 22.2 (#200), Nova Premier 1.0: 23.0 (#185)

Reasoning benchmarks
BenchmarkMistralNova Premier 1.0
Kagi LLM Benchmark—44.8%
LMArena Hard Prompts1149—

Math Nova Premier 1.0 leads

Mistral: 22.3 (#278), Nova Premier 1.0: 33.8 (#199)

Math benchmarks
BenchmarkMistralNova Premier 1.0
Omni-MATH7.2%35%
LMArena Math1180—

Knowledge Nova Premier 1.0 leads

Mistral: 16.6 (#288), Nova Premier 1.0: 35.8 (#180)

Knowledge benchmarks
BenchmarkMistralNova Premier 1.0
MMLU-Pro27.7%72.6%
GPQA (HELM)30.3%51.8%
LMArena Expert1125—

Multilingual Not comparable

Mistral: 32.8 (#254), Nova Premier 1.0: —

Multilingual benchmarks
BenchmarkMistralNova Premier 1.0
LMArena Non-English1129—
LMArena Chinese1109—
LMArena French1180—
LMArena German1155—
LMArena Japanese1013—
LMArena Korean1032—
LMArena Russian1168—
LMArena Spanish1143—

Instruction Following Nova Premier 1.0 leads

Mistral: 52.6 (#288), Nova Premier 1.0: 66.8 (#204)

Instruction Following benchmarks
BenchmarkMistralNova Premier 1.0
IFEval56.8%80.3%
LMArena Instruction Following1152—

Long Context Not comparable

Mistral: 35.0 (#245), Nova Premier 1.0: —

Long Context benchmarks
BenchmarkMistralNova Premier 1.0
LMArena Longer Query1153—

Writing & Preference Nova Premier 1.0 leads

Mistral: 37.0 (#260), Nova Premier 1.0: 51.0 (#178)

Writing & Preference benchmarks
BenchmarkMistralNova Premier 1.0
WildBench66%78.8%
LMArena Text1165—
LMArena Creative Writing1158—
LMArena Multi-Turn1147—

Frequently asked questions

Is Mistral better than Nova Premier 1.0?

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 29.9 on the Noometry Index.

How many benchmarks do Mistral and Nova Premier 1.0 share?

5 benchmarks have published results for both models. Mistral has 22 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper