Model comparison

Olmo 3 32b Think vs Sonar

Olmo 3 32b Think and Sonar score almost the same on the Noometry Index (38.7 vs 38.5), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • The widest gap is in reasoning, where Olmo 3 32b Think leads 25.9 to 21.1.
  • Olmo 3 32b Think has downloadable open weights; the other is API-only.

Side by side

Olmo 3 32b Think and Sonar specifications
Olmo 3 32b ThinkSonar
ProviderAllen Institute for AI (Ai2)Perplexity
Noometry Index38.738.5
Released—2024-01-01
WeightsOpenProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked147

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Olmo 3 32b Think leads

Olmo 3 32b Think: 38.6 (#172), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkOlmo 3 32b ThinkSonar
LiveBench Coding—35.1%
LMArena Coding1319—

Reasoning Olmo 3 32b Think leads

Olmo 3 32b Think: 25.9 (#140), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkOlmo 3 32b ThinkSonar
LiveBench Reasoning—46.3%
LMArena Hard Prompts1302—
LiveBench Data Analysis—37.9%
LiveBench—46.9%

Math Olmo 3 32b Think leads

Olmo 3 32b Think: 36.5 (#165), Sonar: 33.7 (#200)

Math benchmarks
BenchmarkOlmo 3 32b ThinkSonar
LiveBench Math—41.6%
LMArena Math1316—

Knowledge Not comparable

Olmo 3 32b Think: 35.0 (#190), Sonar: —

Knowledge benchmarks
BenchmarkOlmo 3 32b ThinkSonar
LMArena Expert1273—

Multilingual Not comparable

Olmo 3 32b Think: 41.2 (#210), Sonar: —

Multilingual benchmarks
BenchmarkOlmo 3 32b ThinkSonar
LMArena Non-English1255—
LMArena Chinese1300—
LMArena French1291—
LMArena German1290—
LMArena Russian1254—

Instruction Following Sonar leads

Olmo 3 32b Think: 67.2 (#198), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkOlmo 3 32b ThinkSonar
LiveBench Instruction Following—76.2%
LMArena Instruction Following1275—

Long Context Not comparable

Olmo 3 32b Think: 39.4 (#182), Sonar: —

Long Context benchmarks
BenchmarkOlmo 3 32b ThinkSonar
LMArena Longer Query1296—

Writing & Preference Sonar leads

Olmo 3 32b Think: 49.1 (#193), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkOlmo 3 32b ThinkSonar
LMArena Text1300—
LMArena Creative Writing1256—
LMArena Multi-Turn1290—
LiveBench Language—44.1%

Frequently asked questions

Is Olmo 3 32b Think better than Sonar?

Olmo 3 32b Think and Sonar score almost the same on the Noometry Index (38.7 vs 38.5), so choose on price, context window or the category you care about most.

Is Olmo 3 32b Think or Sonar better for coding?

Olmo 3 32b Think scores higher on coding benchmarks: 38.6 versus 35.7 in the Noometry coding category.

How many benchmarks do Olmo 3 32b Think and Sonar share?

0 benchmarks have published results for both models. Olmo 3 32b Think has 14 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper