Model comparison

Mistral Small 3 vs Solar Pro4

Solar Pro4 is the stronger model overall, scoring 42.1 to 31.2 on the Noometry Index. Mistral Small 3 costs 9.1× less per token, which makes it the better buy when Solar Pro4's lead doesn't matter for your workload.

Last verified . 16 shared benchmarks.

Mistral Small 3 Mistral AI

31.2

Rank #278 Confirmed

Solar Pro4 Upstage

42.1

Rank #121 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Mistral Small 3 scores higher in 0 categories and Solar Pro4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Solar Pro4 leads 56.5 to 32.2.
  • Mistral Small 3 is cheaper at $0.05 / $0.08 per million input/output tokens, against $0.30 / $1.20 for Solar Pro4.
  • Solar Pro4 accepts more context: 524K tokens versus 33K.
  • Mistral Small 3 has downloadable open weights; the other is API-only.

Side by side

Mistral Small 3 and Solar Pro4 specifications
Mistral Small 3Solar Pro4
ProviderMistral AIUpstage
Noometry Index31.242.1
Released2025-01-302026-08-06
WeightsOpenProprietary
Context window33K524K
Max output16K131K
Input $ / M tokens$0.05$0.30
Output $ / M tokens$0.08$1.20
Results tracked2418

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Solar Pro4 leads

Mistral Small 3: 36.5 (#207), Solar Pro4: 40.1 (#149)

Coding benchmarks
BenchmarkMistral Small 3Solar Pro4
LMArena Coding12461437
LMArena WebDev—1371
BigCodeBench Instruct45.3%—
BigCodeBench Complete50.4%—

Reasoning Solar Pro4 leads

Mistral Small 3: 18.9 (#273), Solar Pro4: 28.5 (#104)

Reasoning benchmarks
BenchmarkMistral Small 3Solar Pro4
LMArena Hard Prompts12331399
Chess Puzzles0%—
Epoch Capabilities Index127.07—

Math Solar Pro4 leads

Mistral Small 3: 16.3 (#295), Solar Pro4: 38.8 (#128)

Math benchmarks
BenchmarkMistral Small 3Solar Pro4
LMArena Math12401416
OTIS Mock AIME 2024-20256.7%—

Knowledge Solar Pro4 leads

Mistral Small 3: 25.1 (#263), Solar Pro4: 39.8 (#129)

Knowledge benchmarks
BenchmarkMistral Small 3Solar Pro4
LMArena Expert12021427
GPQA Diamond47.3%—
Confabulations25.2%—

Multilingual Solar Pro4 leads

Mistral Small 3: 37.3 (#236), Solar Pro4: 48.7 (#139)

Multilingual benchmarks
BenchmarkMistral Small 3Solar Pro4
LMArena Non-English11981361
LMArena Chinese12041415
LMArena French12031397
LMArena German12111364
LMArena Japanese11111309
LMArena Korean11881382
LMArena Russian12161360
LMArena Spanish—1401

Instruction Following Solar Pro4 leads

Mistral Small 3: 63.7 (#229), Solar Pro4: 72.7 (#132)

Instruction Following benchmarks
BenchmarkMistral Small 3Solar Pro4
LMArena Instruction Following12141377

Long Context Solar Pro4 leads

Mistral Small 3: 37.8 (#211), Solar Pro4: 42.1 (#130)

Long Context benchmarks
BenchmarkMistral Small 3Solar Pro4
LMArena Longer Query12461381

Writing & Preference Solar Pro4 leads

Mistral Small 3: 32.2 (#280), Solar Pro4: 56.5 (#138)

Writing & Preference benchmarks
BenchmarkMistral Small 3Solar Pro4
LMArena Text12341386
LMArena Creative Writing11951316
LMArena Multi-Turn12171385
EQ-Bench Creative Writing707—

Frequently asked questions

Is Mistral Small 3 better than Solar Pro4?

Solar Pro4 is the stronger model overall, scoring 42.1 to 31.2 on the Noometry Index. Mistral Small 3 costs 9.1× less per token, which makes it the better buy when Solar Pro4's lead doesn't matter for your workload.

Which is cheaper, Mistral Small 3 or Solar Pro4?

Mistral Small 3 is cheaper. It lists at $0.05 per million input tokens and $0.08 per million output tokens; Solar Pro4 lists at $0.30 and $1.20.

Is Mistral Small 3 or Solar Pro4 better for coding?

Solar Pro4 scores higher on coding benchmarks: 40.1 versus 36.5 in the Noometry coding category.

Which has the bigger context window?

Solar Pro4 does, with 524K tokens against 33K.

How many benchmarks do Mistral Small 3 and Solar Pro4 share?

16 benchmarks have published results for both models. Mistral Small 3 has 24 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper