Model comparison

Qwen2.5 72B Instruct vs Solar Pro4

Solar Pro4 is the stronger model overall, scoring 42.1 to 31.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Qwen2.5 72B Instruct Alibaba (Qwen)

31.9

Rank #267 Confirmed

Solar Pro4 Upstage

42.1

Rank #121 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Qwen2.5 72B Instruct scores higher in 0 categories and Solar Pro4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Solar Pro4 leads 38.8 to 19.3.
  • Solar Pro4 is cheaper at $0.30 / $1.20 per million input/output tokens, against $1.40 / $5.60 for Qwen2.5 72B Instruct.
  • Solar Pro4 accepts more context: 524K tokens versus 131K.
  • Qwen2.5 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Qwen2.5 72B Instruct and Solar Pro4 specifications
Qwen2.5 72B InstructSolar Pro4
ProviderAlibaba (Qwen)Upstage
Noometry Index31.942.1
Released2024-092026-08-06
WeightsOpenProprietary
Context window131K524K
Max output8K131K
Input $ / M tokens$1.40$0.30
Output $ / M tokens$5.60$1.20
Results tracked4318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Solar Pro4 leads

Qwen2.5 72B Instruct: 33.2 (#260), Solar Pro4: 40.1 (#149)

Coding benchmarks
BenchmarkQwen2.5 72B InstructSolar Pro4
LMArena Coding12921437
LMArena WebDev—1371
WeirdML16%—
BigCodeBench Instruct45.8%—
BigCodeBench Complete55.9%—

Agentic & Tool Use Not comparable

Qwen2.5 72B Instruct: 22.1 (#133), Solar Pro4: —

Agentic & Tool Use benchmarks
BenchmarkQwen2.5 72B InstructSolar Pro4
TheAgentCompany5.7%—
BALROG16.2%—
METR Time Horizons35.8%—

Reasoning Solar Pro4 leads

Qwen2.5 72B Instruct: 22.3 (#199), Solar Pro4: 28.5 (#104)

Reasoning benchmarks
BenchmarkQwen2.5 72B InstructSolar Pro4
LMArena Hard Prompts12711399
DTBench62.9%—
LMCA13.4%—
BIG-Bench Hard79.8%—
Epoch Capabilities Index129—
ForecastBench57.5—
HellaSwag84.8%—
PIQA82.6%—
WinoGrande82.3%—

Math Solar Pro4 leads

Qwen2.5 72B Instruct: 19.3 (#287), Solar Pro4: 38.8 (#128)

Math benchmarks
BenchmarkQwen2.5 72B InstructSolar Pro4
LMArena Math12831416
OTIS Mock AIME 2024-20258.1%—
Omni-MATH33%—
MATH Level 563.2%—

Knowledge Solar Pro4 leads

Qwen2.5 72B Instruct: 27.0 (#253), Solar Pro4: 39.8 (#129)

Knowledge benchmarks
BenchmarkQwen2.5 72B InstructSolar Pro4
LMArena Expert12451427
GPQA Diamond49.1%—
MMLU-Pro63.1%—
Confabulations19.1%—
GPQA (HELM)42.6%—
ARC (AI2) Challenge94.5%—
MMLU85.3%—
TriviaQA71.9%—

Multilingual Solar Pro4 leads

Qwen2.5 72B Instruct: 41.0 (#213), Solar Pro4: 48.7 (#139)

Multilingual benchmarks
BenchmarkQwen2.5 72B InstructSolar Pro4
LMArena Non-English12521361
LMArena Chinese12721415
LMArena French12801397
LMArena German12341364
LMArena Japanese11801309
LMArena Korean11881382
LMArena Russian12641360
LMArena Spanish12561401

Instruction Following Solar Pro4 leads

Qwen2.5 72B Instruct: 65.5 (#221), Solar Pro4: 72.7 (#132)

Instruction Following benchmarks
BenchmarkQwen2.5 72B InstructSolar Pro4
LMArena Instruction Following12541377
IFEval80.6%—

Long Context Solar Pro4 leads

Qwen2.5 72B Instruct: 38.9 (#188), Solar Pro4: 42.1 (#130)

Long Context benchmarks
BenchmarkQwen2.5 72B InstructSolar Pro4
LMArena Longer Query12821381

Writing & Preference Solar Pro4 leads

Qwen2.5 72B Instruct: 46.7 (#215), Solar Pro4: 56.5 (#138)

Writing & Preference benchmarks
BenchmarkQwen2.5 72B InstructSolar Pro4
LMArena Text12691386
LMArena Creative Writing12211316
LMArena Multi-Turn12721385
WildBench80.2%—

Frequently asked questions

Is Qwen2.5 72B Instruct better than Solar Pro4?

Solar Pro4 is the stronger model overall, scoring 42.1 to 31.9 on the Noometry Index.

Which is cheaper, Qwen2.5 72B Instruct or Solar Pro4?

Solar Pro4 is cheaper. It lists at $0.30 per million input tokens and $1.20 per million output tokens; Qwen2.5 72B Instruct lists at $1.40 and $5.60.

Is Qwen2.5 72B Instruct or Solar Pro4 better for coding?

Solar Pro4 scores higher on coding benchmarks: 40.1 versus 33.2 in the Noometry coding category.

Which has the bigger context window?

Solar Pro4 does, with 524K tokens against 131K.

How many benchmarks do Qwen2.5 72B Instruct and Solar Pro4 share?

17 benchmarks have published results for both models. Qwen2.5 72B Instruct has 43 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper