Model comparison

GPT-5.6 Sol vs Qwen1.5-32B

GPT-5.6 Sol is the stronger model overall, scoring 65.0 to 30.5 on the Noometry Index.

Last verified . 18 shared benchmarks.

GPT-5.6 Sol OpenAI

65.0

Rank #7 Confirmed

Qwen1.5-32B Alibaba (Qwen)

30.5

Rank #293 Confirmed

Summary

  • They share 18 benchmarks with published results for both. GPT-5.6 Sol scores higher in 8 categories and Qwen1.5-32B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5.6 Sol leads 74.8 to 21.8.
  • The biggest single-benchmark swing is GPQA Diamond: 93.5% for GPT-5.6 Sol and 30.7% for Qwen1.5-32B.
  • Qwen1.5-32B has downloadable open weights; the other is API-only.

Side by side

GPT-5.6 Sol and Qwen1.5-32B specifications
GPT-5.6 SolQwen1.5-32B
ProviderOpenAIAlibaba (Qwen)
Noometry Index65.030.5
Released2026-07-092024-02-04
WeightsProprietaryOpen
Context window1.05M—
Max output128K—
Input $ / M tokens$4—
Output $ / M tokens$20—
Results tracked6521

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Sol leads

GPT-5.6 Sol: 65.1 (#7), Qwen1.5-32B: 31.7 (#282)

Coding benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
LMArena Coding14981155
DeepSWE72.7%—
FrontierCode47.5%—
CursorBench41.7%—
LMArena WebDev1618—
FrontierSWE32.2%—
SciCode57.1%—
GSO76.5%—
WeirdML89.4%—
BigCodeBench Instruct—32.3%
MirrorCode20%—
BigCodeBench Complete—42%
ALE-Bench2,177—

Agentic & Tool Use Not comparable

GPT-5.6 Sol: 50.3 (#7), Qwen1.5-32B: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
APEX-Agents51.4%—
OSWorld 2.027.3%—
τ²-bench Banking46.9%—
PostTrainBench36.2%—
BALROG60%—
GBAEval52.6%—
GDP.pdf30.7%—
LMArena Search1257—
Vending-Bench 29,619—

Reasoning GPT-5.6 Sol leads

GPT-5.6 Sol: 74.8 (#8), Qwen1.5-32B: 21.8 (#212)

Reasoning benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
LMArena Hard Prompts14841130
ARC-AGI-292.5%—
SimpleBench71.7%—
Kagi LLM Benchmark67%—
NYT Connections (extended)93.8%—
ARC-AGI-197.5%—
CritPt32.3%—
Chess Puzzles64%—
EnigmaEval37.1%—
EBR-Bench44.8%—
Mystery Game Puzzles58%—
DTBench96%—
LMCA59.2%—
Surface Evolver Bench93.1%—
Bench to the Future 30.14—
Epoch Capabilities Index161.66—

Math GPT-5.6 Sol leads

GPT-5.6 Sol: 85.6 (#9), Qwen1.5-32B: 33.0 (#207)

Math benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
LMArena Math14741155
FrontierMath (Tiers 1-3)89.1%—
FrontierMath Tier 482.9%—
OTIS Mock AIME 2024-2025100%—
ProofBench83%—
FrontierMath Erdős0%—

Knowledge GPT-5.6 Sol leads

GPT-5.6 Sol: 64.3 (#18), Qwen1.5-32B: 13.5 (#296)

Knowledge benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
GPQA Diamond93.5%30.7%
LMArena Expert15161126
SimpleQA Verified69.7%—
Vectara Hallucination Rate12.4%—
MMLU—74.4%

Multimodal Not comparable

GPT-5.6 Sol: 48.6 (#9), Qwen1.5-32B: —

Multimodal benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
LMArena Vision1281—
Blueprint-Bench 233.6%—
Furniture Assembly56.7%—
LMArena Document1483—

Multilingual GPT-5.6 Sol leads

GPT-5.6 Sol: 55.3 (#32), Qwen1.5-32B: 31.4 (#259)

Multilingual benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
LMArena Non-English14521106
LMArena Chinese15271177
LMArena French14771101
LMArena German14761058
LMArena Japanese14711027
LMArena Korean14421008
LMArena Russian14681073
LMArena Spanish14411089

Instruction Following GPT-5.6 Sol leads

GPT-5.6 Sol: 77.7 (#16), Qwen1.5-32B: 57.7 (#265)

Instruction Following benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
LMArena Instruction Following14821116

Long Context GPT-5.6 Sol leads

GPT-5.6 Sol: 45.4 (#42), Qwen1.5-32B: 34.7 (#246)

Long Context benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
LMArena Longer Query14801146

Writing & Preference GPT-5.6 Sol leads

GPT-5.6 Sol: 73.3 (#12), Qwen1.5-32B: 34.2 (#271)

Writing & Preference benchmarks
BenchmarkGPT-5.6 SolQwen1.5-32B
LMArena Text14571137
LMArena Creative Writing14481083
LMArena Multi-Turn14601140
EQ-Bench Creative Writing1972—
EQ-Bench 41250—

Frequently asked questions

Is GPT-5.6 Sol better than Qwen1.5-32B?

GPT-5.6 Sol is the stronger model overall, scoring 65.0 to 30.5 on the Noometry Index.

Is GPT-5.6 Sol or Qwen1.5-32B better for coding?

GPT-5.6 Sol scores higher on coding benchmarks: 65.1 versus 31.7 in the Noometry coding category.

How many benchmarks do GPT-5.6 Sol and Qwen1.5-32B share?

18 benchmarks have published results for both models. GPT-5.6 Sol has 65 scored results on Noometry and Qwen1.5-32B has 21.

Related comparisons

Go deeper