Model comparison

Mistral Small vs Nova Premier 1.0

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 33.4 on the Noometry Index. Mistral Small costs 19× less per token, which makes it the better buy when Nova Premier 1.0's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

Nova Premier 1.0 Amazon

38.3

Rank #189 Confirmed

Summary

  • They share 1 benchmark with published results for both. Mistral Small scores higher in 1 category and Nova Premier 1.0 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nova Premier 1.0 leads 33.8 to 16.4.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 37.8% for Mistral Small and 44.8% for Nova Premier 1.0.
  • Mistral Small is cheaper at $0.15 / $0.60 per million input/output tokens, against $2.50 / $12.50 for Nova Premier 1.0.
  • Nova Premier 1.0 accepts more context: 1M tokens versus 262K.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

Mistral Small and Nova Premier 1.0 specifications
Mistral SmallNova Premier 1.0
ProviderMistral AIAmazon
Noometry Index33.438.3
Released2024-02-262025-04-30
WeightsOpenProprietary
Context window262K1M
Max output256K10K
Input $ / M tokens$0.15$2.50
Output $ / M tokens$0.60$12.50
Results tracked396

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Small: 34.0 (#247), Nova Premier 1.0: —

Coding benchmarks
BenchmarkMistral SmallNova Premier 1.0
SciCode26.5%—
BigCodeBench Instruct36.1%—
LiveBench Coding36.2%—
LMArena Coding1362—
BigCodeBench Complete46.6%—
ALE-Bench497.62—

Agentic & Tool Use Not comparable

Mistral Small: 28.1 (#93), Nova Premier 1.0: —

Agentic & Tool Use benchmarks
BenchmarkMistral SmallNova Premier 1.0
Berkeley Function Calling Leaderboard37.1%—

Reasoning Nova Premier 1.0 leads

Mistral Small: 19.8 (#250), Nova Premier 1.0: 23.0 (#185)

Reasoning benchmarks
BenchmarkMistral SmallNova Premier 1.0
Kagi LLM Benchmark37.8%44.8%
CritPt0%—
LiveBench Reasoning44.8%—
LMArena Hard Prompts1335—
DTBench70.9%—
LiveBench Data Analysis53.7%—
LMCA20.6%—
LiveBench44%—

Math Nova Premier 1.0 leads

Mistral Small: 16.4 (#293), Nova Premier 1.0: 33.8 (#199)

Math benchmarks
BenchmarkMistral SmallNova Premier 1.0
OTIS Mock AIME 2024-20255.8%—
Omni-MATH—35%
LiveBench Math39.9%—
LMArena Math1341—
MATH Level 546.8%—

Knowledge Nova Premier 1.0 leads

Mistral Small: 31.0 (#222), Nova Premier 1.0: 35.8 (#180)

Knowledge benchmarks
BenchmarkMistral SmallNova Premier 1.0
GPQA Diamond47.5%—
MMLU-Pro—72.6%
Vectara Hallucination Rate5.1%—
GPQA (HELM)—51.8%
LMArena Expert1291—
MMLU68.7%—

Multimodal Not comparable

Mistral Small: 33.5 (#96), Nova Premier 1.0: —

Multimodal benchmarks
BenchmarkMistral SmallNova Premier 1.0
LMArena Vision1142—

Multilingual Not comparable

Mistral Small: 45.5 (#169), Nova Premier 1.0: —

Multilingual benchmarks
BenchmarkMistral SmallNova Premier 1.0
LMArena Non-English1315—
LMArena Chinese1340—
LMArena French1337—
LMArena German1340—
LMArena Japanese1275—
LMArena Korean1259—
LMArena Russian1324—
LMArena Spanish1346—

Instruction Following Too close to call

Mistral Small: 66.4 (#209), Nova Premier 1.0: 66.8 (#204)

Instruction Following benchmarks
BenchmarkMistral SmallNova Premier 1.0
LiveBench Instruction Following63.7%—
IFEval—80.3%
LMArena Instruction Following1310—

Long Context Not comparable

Mistral Small: 40.4 (#156), Nova Premier 1.0: —

Long Context benchmarks
BenchmarkMistral SmallNova Premier 1.0
LMArena Longer Query1327—

Writing & Preference Mistral Small leads

Mistral Small: 52.5 (#171), Nova Premier 1.0: 51.0 (#178)

Writing & Preference benchmarks
BenchmarkMistral SmallNova Premier 1.0
LMArena Text1338—
LMArena Creative Writing1305—
WildBench—78.8%
LMArena Multi-Turn1344—
LiveBench Language30.5%—

Frequently asked questions

Is Mistral Small better than Nova Premier 1.0?

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 33.4 on the Noometry Index. Mistral Small costs 19× less per token, which makes it the better buy when Nova Premier 1.0's lead doesn't matter for your workload.

Which is cheaper, Mistral Small or Nova Premier 1.0?

Mistral Small is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Nova Premier 1.0 lists at $2.50 and $12.50.

Which has the bigger context window?

Nova Premier 1.0 does, with 1M tokens against 262K.

How many benchmarks do Mistral Small and Nova Premier 1.0 share?

1 benchmark has published results for both models. Mistral Small has 39 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper