Noometry

Model comparison

Mistral Small 3.1 vs Solar Pro4

Solar Pro4 is the stronger model overall, scoring 41.5 to 31.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Mistral Small 3.1 Mistral AI

31.4

Rank #263 Confirmed

Solar Pro4 Upstage

41.5

Rank #123 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Mistral Small 3.1 scores higher in 0 categories and Solar Pro4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Solar Pro4 leads 36.1 to 13.7.
  • Mistral Small 3.1 is cheaper at $0.35 / $0.56 per million input/output tokens, against $0.30 / $1.20 for Solar Pro4.
  • Solar Pro4 accepts more context: 524K tokens versus 128K.
  • Mistral Small 3.1 has downloadable open weights; the other is API-only.

Side by side

Mistral Small 3.1Solar Pro4
ProviderMistral AIUpstage
Noometry Index31.441.5
Released2025-03-172026-08-06
WeightsOpenProprietary
Context window128K524K
Max output102K131K
Input $ / M tokens$0.35$0.30
Output $ / M tokens$0.56$1.20
Results tracked2818

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Solar Pro4 leads

Mistral Small 3.1: 37.7 (#175), Solar Pro4: 39.9 (#135)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Coding13091439
LMArena WebDev—1371

Reasoning Solar Pro4 leads

Mistral Small 3.1: 18.9 (#249), Solar Pro4: 27.3 (#107)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Hard Prompts12781398
Chess Puzzles1%—
Epoch Capabilities Index127.48—

Math Solar Pro4 leads

Mistral Small 3.1: 13.7 (#295), Solar Pro4: 36.1 (#129)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Math12611418
OTIS Mock AIME 2024-20253.9%—
Omni-MATH24.8%—

Knowledge Solar Pro4 leads

Mistral Small 3.1: 22.6 (#266), Solar Pro4: 39.0 (#128)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Expert12581421
GPQA Diamond41.9%—
MMLU-Pro61%—
GPQA (HELM)39.2%—

Multimodal Not comparable

Mistral Small 3.1: 32.6 (#93), Solar Pro4: —

BenchmarkMistral Small 3.1Solar Pro4
LMArena Vision1136—

Multilingual Solar Pro4 leads

Mistral Small 3.1: 41.4 (#204), Solar Pro4: 49.0 (#134)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Non-English12551362
LMArena Chinese12541417
LMArena French12701403
LMArena German12661351
LMArena Japanese12101300
LMArena Korean12061383
LMArena Russian12631360
LMArena Spanish12831408

Instruction Following Solar Pro4 leads

Mistral Small 3.1: 63.8 (#225), Solar Pro4: 72.8 (#128)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Instruction Following12641376
IFEval75%—

Long Context Solar Pro4 leads

Mistral Small 3.1: 39.5 (#172), Solar Pro4: 42.0 (#125)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Longer Query13001379

Writing & Preference Solar Pro4 leads

Mistral Small 3.1: 37.2 (#254), Solar Pro4: 56.7 (#133)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Text12781386
LMArena Creative Writing12531313
LMArena Multi-Turn12701391
EQ-Bench Creative Writing761—
WildBench78.8%—

Frequently asked questions

Is Mistral Small 3.1 better than Solar Pro4?

Solar Pro4 is the stronger model overall, scoring 41.5 to 31.4 on the Noometry Index.

Which is cheaper, Mistral Small 3.1 or Solar Pro4?

Mistral Small 3.1 is cheaper. It lists at $0.35 per million input tokens and $0.56 per million output tokens; Solar Pro4 lists at $0.30 and $1.20.

Is Mistral Small 3.1 or Solar Pro4 better for coding?

Solar Pro4 scores higher on coding benchmarks: 39.9 versus 37.7 in the Noometry coding category.

Which has the bigger context window?

Solar Pro4 does, with 524K tokens against 128K.

How many benchmarks do Mistral Small 3.1 and Solar Pro4 share?

17 benchmarks have published results for both models. Mistral Small 3.1 has 28 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper