Model comparison

Ministral 8B vs Solar Pro4

Solar Pro4 is the stronger model overall, scoring 42.1 to 28.2 on the Noometry Index. Ministral 8B costs 3.5× less per token, which makes it the better buy when Solar Pro4's lead doesn't matter for your workload.

Last verified . 12 shared benchmarks.

Ministral 8B Mistral AI

28.2

Rank #325 Confirmed

Solar Pro4 Upstage

42.1

Rank #121 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Ministral 8B scores higher in 0 categories and Solar Pro4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Solar Pro4 leads 39.8 to 12.6.
  • Ministral 8B is cheaper at $0.15 / $0.15 per million input/output tokens, against $0.30 / $1.20 for Solar Pro4.
  • Solar Pro4 accepts more context: 524K tokens versus 262K.
  • Ministral 8B has downloadable open weights; the other is API-only.

Side by side

Ministral 8B and Solar Pro4 specifications
Ministral 8BSolar Pro4
ProviderMistral AIUpstage
Noometry Index28.242.1
Released2024-10-012026-08-06
WeightsOpenProprietary
Context window262K524K
Max output262K131K
Input $ / M tokens$0.15$0.30
Output $ / M tokens$0.15$1.20
Results tracked1718

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Solar Pro4 leads

Ministral 8B: 35.0 (#230), Solar Pro4: 40.1 (#149)

Coding benchmarks
BenchmarkMinistral 8BSolar Pro4
LMArena Coding12021437
LMArena WebDev—1371

Agentic & Tool Use Not comparable

Ministral 8B: 16.4 (#148), Solar Pro4: —

Agentic & Tool Use benchmarks
BenchmarkMinistral 8BSolar Pro4
Berkeley Function Calling Leaderboard11.1%—

Reasoning Solar Pro4 leads

Ministral 8B: 18.4 (#281), Solar Pro4: 28.5 (#104)

Reasoning benchmarks
BenchmarkMinistral 8BSolar Pro4
LMArena Hard Prompts11911399
DTBench45.7%—

Math Solar Pro4 leads

Ministral 8B: 25.7 (#267), Solar Pro4: 38.8 (#128)

Math benchmarks
BenchmarkMinistral 8BSolar Pro4
LMArena Math11881416
MATH Level 514.9%—

Knowledge Solar Pro4 leads

Ministral 8B: 12.6 (#297), Solar Pro4: 39.8 (#129)

Knowledge benchmarks
BenchmarkMinistral 8BSolar Pro4
LMArena Expert11701427
GPQA Diamond27.1%—
Vectara Hallucination Rate7.4%—

Multilingual Solar Pro4 leads

Ministral 8B: 35.1 (#247), Solar Pro4: 48.7 (#139)

Multilingual benchmarks
BenchmarkMinistral 8BSolar Pro4
LMArena Non-English11651361
LMArena Chinese11931415
LMArena Russian11951360
LMArena French—1397
LMArena German—1364
LMArena Japanese—1309
LMArena Korean—1382
LMArena Spanish—1401

Instruction Following Solar Pro4 leads

Ministral 8B: 60.5 (#250), Solar Pro4: 72.7 (#132)

Instruction Following benchmarks
BenchmarkMinistral 8BSolar Pro4
LMArena Instruction Following11611377

Long Context Solar Pro4 leads

Ministral 8B: 36.7 (#227), Solar Pro4: 42.1 (#130)

Long Context benchmarks
BenchmarkMinistral 8BSolar Pro4
LMArena Longer Query12121381

Writing & Preference Solar Pro4 leads

Ministral 8B: 39.6 (#246), Solar Pro4: 56.5 (#138)

Writing & Preference benchmarks
BenchmarkMinistral 8BSolar Pro4
LMArena Text11911386
LMArena Creative Writing11751316
LMArena Multi-Turn11661385

Frequently asked questions

Is Ministral 8B better than Solar Pro4?

Solar Pro4 is the stronger model overall, scoring 42.1 to 28.2 on the Noometry Index. Ministral 8B costs 3.5× less per token, which makes it the better buy when Solar Pro4's lead doesn't matter for your workload.

Which is cheaper, Ministral 8B or Solar Pro4?

Ministral 8B is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Solar Pro4 lists at $0.30 and $1.20.

Is Ministral 8B or Solar Pro4 better for coding?

Solar Pro4 scores higher on coding benchmarks: 40.1 versus 35.0 in the Noometry coding category.

Which has the bigger context window?

Solar Pro4 does, with 524K tokens against 262K.

How many benchmarks do Ministral 8B and Solar Pro4 share?

12 benchmarks have published results for both models. Ministral 8B has 17 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper