Model comparison

Mistral Nemo vs Solar Pro4

Solar Pro4 is the stronger model overall, scoring 42.1 to 26.4 on the Noometry Index. Mistral Nemo costs 3.5× less per token, which makes it the better buy when Solar Pro4's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Solar Pro4 Upstage

42.1

Rank #121 Confirmed

Summary

  • The widest gap is in writing & preference, where Solar Pro4 leads 56.5 to 28.5.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $0.30 / $1.20 for Solar Pro4.
  • Solar Pro4 accepts more context: 524K tokens versus 128K.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Mistral Nemo and Solar Pro4 specifications
Mistral NemoSolar Pro4
ProviderMistral AIUpstage
Noometry Index26.442.1
Released2024-07-012026-08-06
WeightsOpenProprietary
Context window128K524K
Max output128K131K
Input $ / M tokens$0.15$0.30
Output $ / M tokens$0.15$1.20
Results tracked1018

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Nemo: —, Solar Pro4: 40.1 (#149)

Coding benchmarks
BenchmarkMistral NemoSolar Pro4
LMArena WebDev—1371
LMArena Coding—1437

Agentic & Tool Use Not comparable

Mistral Nemo: 23.5 (#125), Solar Pro4: —

Agentic & Tool Use benchmarks
BenchmarkMistral NemoSolar Pro4
Berkeley Function Calling Leaderboard27.6%—
BALROG17.6%—

Reasoning Solar Pro4 leads

Mistral Nemo: 20.7 (#232), Solar Pro4: 28.5 (#104)

Reasoning benchmarks
BenchmarkMistral NemoSolar Pro4
LMArena Hard Prompts—1399
DTBench48.6%—
Epoch Capabilities Index118.68—
PIQA83.5%—

Math Solar Pro4 leads

Mistral Nemo: 25.5 (#268), Solar Pro4: 38.8 (#128)

Math benchmarks
BenchmarkMistral NemoSolar Pro4
LMArena Math—1416
MATH Level 510.8%—
GSM8K84.2%—

Knowledge Solar Pro4 leads

Mistral Nemo: 12.3 (#298), Solar Pro4: 39.8 (#129)

Knowledge benchmarks
BenchmarkMistral NemoSolar Pro4
GPQA Diamond29.9%—
LMArena Expert—1427
BoolQ82.5%—

Multilingual Not comparable

Mistral Nemo: —, Solar Pro4: 48.7 (#139)

Multilingual benchmarks
BenchmarkMistral NemoSolar Pro4
LMArena Non-English—1361
LMArena Chinese—1415
LMArena French—1397
LMArena German—1364
LMArena Japanese—1309
LMArena Korean—1382
LMArena Russian—1360
LMArena Spanish—1401

Instruction Following Not comparable

Mistral Nemo: —, Solar Pro4: 72.7 (#132)

Instruction Following benchmarks
BenchmarkMistral NemoSolar Pro4
LMArena Instruction Following—1377

Long Context Not comparable

Mistral Nemo: —, Solar Pro4: 42.1 (#130)

Long Context benchmarks
BenchmarkMistral NemoSolar Pro4
LMArena Longer Query—1381

Writing & Preference Solar Pro4 leads

Mistral Nemo: 28.5 (#296), Solar Pro4: 56.5 (#138)

Writing & Preference benchmarks
BenchmarkMistral NemoSolar Pro4
LMArena Text—1386
LMArena Creative Writing—1316
EQ-Bench Creative Writing881—
LMArena Multi-Turn—1385

Frequently asked questions

Is Mistral Nemo better than Solar Pro4?

Solar Pro4 is the stronger model overall, scoring 42.1 to 26.4 on the Noometry Index. Mistral Nemo costs 3.5× less per token, which makes it the better buy when Solar Pro4's lead doesn't matter for your workload.

Which is cheaper, Mistral Nemo or Solar Pro4?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Solar Pro4 lists at $0.30 and $1.20.

Which has the bigger context window?

Solar Pro4 does, with 524K tokens against 128K.

How many benchmarks do Mistral Nemo and Solar Pro4 share?

0 benchmarks have published results for both models. Mistral Nemo has 10 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper