Model comparison

Sonar vs Yi-1.5-34B

Sonar is the stronger model overall, scoring 38.5 to 30.6 on the Noometry Index.

Last verified . 0 shared benchmarks.

Sonar Perplexity

38.5

Rank #187 Confirmed

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Summary

  • The widest gap is in writing & preference, where Sonar leads 52.6 to 37.4.
  • Yi-1.5-34B has downloadable open weights; the other is API-only.

Side by side

Sonar and Yi-1.5-34B specifications
SonarYi-1.5-34B
ProviderPerplexity01.AI
Noometry Index38.530.6
Released2024-01-012024-05-13
WeightsProprietaryOpen
Context window128K—
Max output4K—
Input $ / M tokens$1—
Output $ / M tokens$1—
Results tracked721

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Sonar leads

Sonar: 35.7 (#221), Yi-1.5-34B: 32.4 (#272)

Coding benchmarks
BenchmarkSonarYi-1.5-34B
BigCodeBench Instruct—33.9%
LiveBench Coding35.1%—
LMArena Coding—1169
BigCodeBench Complete—43.8%

Reasoning Yi-1.5-34B leads

Sonar: 21.1 (#227), Yi-1.5-34B: 22.5 (#191)

Reasoning benchmarks
BenchmarkSonarYi-1.5-34B
LiveBench Reasoning46.3%—
LMArena Hard Prompts—1160
LiveBench Data Analysis37.9%—
LiveBench46.9%—

Math Sonar leads

Sonar: 33.7 (#200), Yi-1.5-34B: 27.5 (#249)

Math benchmarks
BenchmarkSonarYi-1.5-34B
LiveBench Math41.6%—
LMArena Math—1182
MATH Level 5—25.5%

Knowledge Not comparable

Sonar: —, Yi-1.5-34B: 14.8 (#295)

Knowledge benchmarks
BenchmarkSonarYi-1.5-34B
GPQA Diamond—32%
LMArena Expert—1144

Multilingual Not comparable

Sonar: —, Yi-1.5-34B: 32.3 (#256)

Multilingual benchmarks
BenchmarkSonarYi-1.5-34B
LMArena Non-English—1121
LMArena Chinese—1213
LMArena French—1156
LMArena German—1111
LMArena Japanese—1021
LMArena Korean—1005
LMArena Russian—1091
LMArena Spanish—1121

Instruction Following Sonar leads

Sonar: 71.4 (#150), Yi-1.5-34B: 59.2 (#257)

Instruction Following benchmarks
BenchmarkSonarYi-1.5-34B
LiveBench Instruction Following76.2%—
LMArena Instruction Following—1139

Long Context Not comparable

Sonar: —, Yi-1.5-34B: 34.6 (#248)

Long Context benchmarks
BenchmarkSonarYi-1.5-34B
LMArena Longer Query—1143

Writing & Preference Sonar leads

Sonar: 52.6 (#167), Yi-1.5-34B: 37.4 (#257)

Writing & Preference benchmarks
BenchmarkSonarYi-1.5-34B
LMArena Text—1173
LMArena Creative Writing—1135
LMArena Multi-Turn—1153
LiveBench Language44.1%—

Frequently asked questions

Is Sonar better than Yi-1.5-34B?

Sonar is the stronger model overall, scoring 38.5 to 30.6 on the Noometry Index.

Is Sonar or Yi-1.5-34B better for coding?

Sonar scores higher on coding benchmarks: 35.7 versus 32.4 in the Noometry coding category.

How many benchmarks do Sonar and Yi-1.5-34B share?

0 benchmarks have published results for both models. Sonar has 7 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper