Noometry

Model comparison

Qwen3 235B-A22B vs Solar Pro4

Qwen3 235B-A22B is the stronger model overall, scoring 43.2 to 41.5 on the Noometry Index. Solar Pro4 costs 2.3× less per token, which makes it the better buy when Qwen3 235B-A22B's lead doesn't matter for your workload.

Last verified . 17 shared benchmarks.

Qwen3 235B-A22B Alibaba (Qwen)

43.2

Rank #83 Confirmed

Solar Pro4 Upstage

41.5

Rank #123 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Qwen3 235B-A22B scores higher in 6 categories and Solar Pro4 in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3 235B-A22B leads 48.5 to 36.1.
  • Solar Pro4 is cheaper at $0.30 / $1.20 per million input/output tokens, against $0.70 / $2.80 for Qwen3 235B-A22B.
  • Solar Pro4 accepts more context: 524K tokens versus 131K.
  • Qwen3 235B-A22B has downloadable open weights; the other is API-only.

Side by side

Qwen3 235B-A22BSolar Pro4
ProviderAlibaba (Qwen)Upstage
Noometry Index43.241.5
Released2025-042026-08-06
WeightsOpenProprietary
Context window131K524K
Max output16K131K
Input $ / M tokens$0.70$0.30
Output $ / M tokens$2.80$1.20
Results tracked4918

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 235B-A22B leads

Qwen3 235B-A22B: 43.8 (#72), Solar Pro4: 39.9 (#135)

BenchmarkQwen3 235B-A22BSolar Pro4
LMArena Coding14451439
Aider Polyglot59.6%—
LMArena WebDev—1371
SciCode42.4%—
WeirdML41%—

Agentic & Tool Use Not comparable

Qwen3 235B-A22B: 33.7 (#48), Solar Pro4: —

BenchmarkQwen3 235B-A22BSolar Pro4
Berkeley Function Calling Leaderboard52.1%—
Vending-Bench 2-11.34—

Reasoning Solar Pro4 leads

Qwen3 235B-A22B: 15.8 (#302), Solar Pro4: 27.3 (#107)

BenchmarkQwen3 235B-A22BSolar Pro4
LMArena Hard Prompts14331398
ARC-AGI-21.3%—
SimpleBench31%—
Kagi LLM Benchmark69.4%—
ARC-AGI-111%—
CritPt0%—
Chess Puzzles12%—
Mystery Game Puzzles9%—
DTBench80.3%—
LMCA29.3%—
Epoch Capabilities Index143.87—
ForecastBench59.7—

Math Qwen3 235B-A22B leads

Qwen3 235B-A22B: 48.5 (#51), Solar Pro4: 36.1 (#129)

BenchmarkQwen3 235B-A22BSolar Pro4
LMArena Math14311418
OTIS Mock AIME 2024-202586.7%—
Omni-MATH71.8%—
MATH Level 568.9%—
FrontierMath (Feb 2025 set)8.5%—
FrontierMath Tier 4 (v1)0%—

Knowledge Qwen3 235B-A22B leads

Qwen3 235B-A22B: 49.5 (#67), Solar Pro4: 39.0 (#128)

BenchmarkQwen3 235B-A22BSolar Pro4
LMArena Expert14601421
GPQA Diamond80.1%—
SimpleQA Verified40.4%—
MMLU-Pro84.4%—
Confabulations15.6%—
Vectara Hallucination Rate9.3%—
GPQA (HELM)72.7%—

Multilingual Qwen3 235B-A22B leads

Qwen3 235B-A22B: 52.5 (#84), Solar Pro4: 49.0 (#134)

BenchmarkQwen3 235B-A22BSolar Pro4
LMArena Non-English14101362
LMArena Chinese14811417
LMArena French14451403
LMArena German14321351
LMArena Japanese14001300
LMArena Korean13911383
LMArena Russian14111360
LMArena Spanish14291408

Instruction Following Too close to call

Qwen3 235B-A22B: 72.8 (#132), Solar Pro4: 72.8 (#128)

BenchmarkQwen3 235B-A22BSolar Pro4
LMArena Instruction Following14081376
IFEval83.5%—

Long Context Qwen3 235B-A22B leads

Qwen3 235B-A22B: 46.1 (#25), Solar Pro4: 42.0 (#125)

BenchmarkQwen3 235B-A22BSolar Pro4
LMArena Longer Query14261379
Fiction.LiveBench75%—

Writing & Preference Qwen3 235B-A22B leads

Qwen3 235B-A22B: 59.8 (#103), Solar Pro4: 56.7 (#133)

BenchmarkQwen3 235B-A22BSolar Pro4
LMArena Text14191386
LMArena Creative Writing13841313
LMArena Multi-Turn14321391
Short-Story Creative Writing83%—
EQ-Bench Creative Writing1366—
WildBench86.6%—

Frequently asked questions

Is Qwen3 235B-A22B better than Solar Pro4?

Qwen3 235B-A22B is the stronger model overall, scoring 43.2 to 41.5 on the Noometry Index. Solar Pro4 costs 2.3× less per token, which makes it the better buy when Qwen3 235B-A22B's lead doesn't matter for your workload.

Which is cheaper, Qwen3 235B-A22B or Solar Pro4?

Solar Pro4 is cheaper. It lists at $0.30 per million input tokens and $1.20 per million output tokens; Qwen3 235B-A22B lists at $0.70 and $2.80.

Is Qwen3 235B-A22B or Solar Pro4 better for coding?

Qwen3 235B-A22B scores higher on coding benchmarks: 43.8 versus 39.9 in the Noometry coding category.

Which has the bigger context window?

Solar Pro4 does, with 524K tokens against 131K.

How many benchmarks do Qwen3 235B-A22B and Solar Pro4 share?

17 benchmarks have published results for both models. Qwen3 235B-A22B has 49 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper