Model comparison

QwQ-32B vs Sonar

QwQ-32B is the stronger model overall, scoring 39.8 to 38.5 on the Noometry Index.

Last verified . 7 shared benchmarks.

QwQ-32B Alibaba (Qwen)

39.8

Rank #159 Confirmed

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • They share 7 benchmarks with published results for both. QwQ-32B scores higher in 3 categories and Sonar in 2 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where QwQ-32B leads 38.0 to 33.7.
  • The biggest single-benchmark swing is LiveBench Reasoning: 83.5% for QwQ-32B and 46.3% for Sonar.
  • QwQ-32B has downloadable open weights; the other is API-only.

Side by side

QwQ-32B and Sonar specifications
QwQ-32BSonar
ProviderAlibaba (Qwen)Perplexity
Noometry Index39.838.5
Released2024-11-282024-01-01
WeightsOpenProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked367

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

QwQ-32B: 35.4 (#226), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkQwQ-32BSonar
LiveBench Coding72.2%35.1%
Aider Polyglot20.9%—
BigCodeBench Instruct44.6%—
LMArena Coding1333—
BigCodeBench Complete54.4%—

Reasoning QwQ-32B leads

QwQ-32B: 23.7 (#174), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkQwQ-32BSonar
LiveBench Reasoning83.5%46.3%
LiveBench Data Analysis65%37.9%
LiveBench72%46.9%
Chess Puzzles5%—
LMArena Hard Prompts1325—
Epoch Capabilities Index137.6—
ForecastBench58.3—

Math QwQ-32B leads

QwQ-32B: 38.0 (#143), Sonar: 33.7 (#200)

Math benchmarks
BenchmarkQwQ-32BSonar
LiveBench Math77.8%41.6%
OTIS Mock AIME 2024-202559.2%—
LMArena Math1359—

Knowledge Not comparable

QwQ-32B: 37.2 (#158), Sonar: —

Knowledge benchmarks
BenchmarkQwQ-32BSonar
GPQA Diamond65.3%—
Confabulations15.6%—
LMArena Expert1324—

Multilingual Not comparable

QwQ-32B: 44.8 (#176), Sonar: —

Multilingual benchmarks
BenchmarkQwQ-32BSonar
LMArena Non-English1305—
LMArena Chinese1378—
LMArena French1336—
LMArena German1313—
LMArena Japanese1262—
LMArena Korean1279—
LMArena Russian1297—
LMArena Spanish1354—

Instruction Following QwQ-32B leads

QwQ-32B: 72.6 (#137), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkQwQ-32BSonar
LiveBench Instruction Following81.8%76.2%
LMArena Instruction Following1297—

Long Context Not comparable

QwQ-32B: 49.0 (#11), Sonar: —

Long Context benchmarks
BenchmarkQwQ-32BSonar
Fiction.LiveBench83.3%—
LMArena Longer Query1308—

Writing & Preference Sonar leads

QwQ-32B: 50.6 (#180), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkQwQ-32BSonar
LiveBench Language51.4%44.1%
LMArena Text1329—
LMArena Creative Writing1288—
Short-Story Creative Writing80.2%—
EQ-Bench Creative Writing1257—
LMArena Multi-Turn1314—

Frequently asked questions

Is QwQ-32B better than Sonar?

QwQ-32B is the stronger model overall, scoring 39.8 to 38.5 on the Noometry Index.

Is QwQ-32B or Sonar better for coding?

They score almost the same on coding (35.4 vs 35.7); test both on your own repository before choosing.

How many benchmarks do QwQ-32B and Sonar share?

7 benchmarks have published results for both models. QwQ-32B has 36 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper