Model comparison

Mercury 2.5 vs Mistral Small

Mistral Small has enough public results to be ranked (#238); Mercury 2.5 does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Mercury 2.5 Inception

30.2

Unranked Sparse

Mistral Small Mistral AI

33.1

Rank #238 Confirmed

Summary

  • They share 1 benchmark with published results for both. Mercury 2.5 scores higher in 1 category and Mistral Small in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in math, where Mercury 2.5 leads 22.4 to 15.4.
  • Mercury 2.5 is cheaper at $0.04 / $0.15 per million input/output tokens, against $0.15 / $0.60 for Mistral Small.
  • Mercury 2.5 accepts more context: 260K tokens versus 256K.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

Mercury 2.5 and Mistral Small specifications
Mercury 2.5Mistral Small
ProviderInceptionMistral AI
Noometry Index30.233.1
Released2026-09-082024-02-26
WeightsProprietaryOpen
Context window260K256K
Max output66K256K
Input $ / M tokens$0.04$0.15
Output $ / M tokens$0.15$0.60
Results tracked239

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mercury 2.5: —, Mistral Small: 33.5 (#242)

Coding benchmarks
BenchmarkMercury 2.5Mistral Small
ALE-Bench301.65497.62
SciCode—26.5%
BigCodeBench Instruct—36.1%
LiveBench Coding—36.2%
LMArena Coding—1363
BigCodeBench Complete—46.6%

Agentic & Tool Use Not comparable

Mercury 2.5: —, Mistral Small: 27.9 (#87)

Agentic & Tool Use benchmarks
BenchmarkMercury 2.5Mistral Small
Berkeley Function Calling Leaderboard—37.1%

Reasoning Not comparable

Mercury 2.5: —, Mistral Small: 19.3 (#238)

Reasoning benchmarks
BenchmarkMercury 2.5Mistral Small
Kagi LLM Benchmark—37.8%
CritPt—0%
LiveBench Reasoning—44.8%
LMArena Hard Prompts—1336
DTBench—70.9%
LiveBench Data Analysis—53.7%
LMCA—20.6%
LiveBench—44%

Math Mercury 2.5 leads

Mercury 2.5: 22.4, Mistral Small: 15.4 (#287)

Math benchmarks
BenchmarkMercury 2.5Mistral Small
OTIS Mock AIME 2024-2025—5.8%
ProofBench3%—
LiveBench Math—39.9%
LMArena Math—1341
MATH Level 5—46.8%

Knowledge Not comparable

Mercury 2.5: —, Mistral Small: 30.9 (#214)

Knowledge benchmarks
BenchmarkMercury 2.5Mistral Small
GPQA Diamond—47.5%
Vectara Hallucination Rate—5.1%
LMArena Expert—1293
MMLU—68.7%

Multimodal Not comparable

Mercury 2.5: —, Mistral Small: 32.9 (#91)

Multimodal benchmarks
BenchmarkMercury 2.5Mistral Small
LMArena Vision—1142

Multilingual Not comparable

Mercury 2.5: —, Mistral Small: 45.7 (#164)

Multilingual benchmarks
BenchmarkMercury 2.5Mistral Small
LMArena Non-English—1315
LMArena Chinese—1342
LMArena French—1337
LMArena German—1341
LMArena Japanese—1275
LMArena Korean—1260
LMArena Russian—1324
LMArena Spanish—1346

Instruction Following Not comparable

Mercury 2.5: —, Mistral Small: 66.6 (#204)

Instruction Following benchmarks
BenchmarkMercury 2.5Mistral Small
LiveBench Instruction Following—63.7%
LMArena Instruction Following—1310

Long Context Not comparable

Mercury 2.5: —, Mistral Small: 40.4 (#151)

Long Context benchmarks
BenchmarkMercury 2.5Mistral Small
LMArena Longer Query—1327

Writing & Preference Not comparable

Mercury 2.5: —, Mistral Small: 52.6 (#165)

Writing & Preference benchmarks
BenchmarkMercury 2.5Mistral Small
LMArena Text—1338
LMArena Creative Writing—1304
LMArena Multi-Turn—1344
LiveBench Language—30.5%

Frequently asked questions

Is Mercury 2.5 better than Mistral Small?

Mistral Small has enough public results to be ranked (#238); Mercury 2.5 does not yet, so treat this comparison as directional.

Which is cheaper, Mercury 2.5 or Mistral Small?

Mercury 2.5 is cheaper. It lists at $0.04 per million input tokens and $0.15 per million output tokens; Mistral Small lists at $0.15 and $0.60.

Which has the bigger context window?

Mercury 2.5 does, with 260K tokens against 256K.

How many benchmarks do Mercury 2.5 and Mistral Small share?

1 benchmark has published results for both models. Mercury 2.5 has 2 scored results on Noometry and Mistral Small has 39.

Related comparisons

Go deeper