Model comparison

Sonar vs Yi-34B

Sonar is the stronger model overall, scoring 38.5 to 27.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

Sonar Perplexity

38.5

Rank #187 Confirmed

Yi-34B 01.AI

27.8

Rank #329 Confirmed

Summary

  • The widest gap is in writing & preference, where Sonar leads 52.6 to 34.1.
  • Yi-34B has downloadable open weights; the other is API-only.

Side by side

Sonar and Yi-34B specifications
SonarYi-34B
ProviderPerplexity01.AI
Noometry Index38.527.8
Released2024-01-012023-11-02
WeightsProprietaryOpen
Context window128K—
Max output4K—
Input $ / M tokens$1—
Output $ / M tokens$1—
Results tracked723

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Sonar leads

Sonar: 35.7 (#221), Yi-34B: 32.3 (#274)

Coding benchmarks
BenchmarkSonarYi-34B
LiveBench Coding35.1%—
LMArena Coding—1112

Reasoning Too close to call

Sonar: 21.1 (#227), Yi-34B: 21.2 (#226)

Reasoning benchmarks
BenchmarkSonarYi-34B
LiveBench Reasoning46.3%—
LMArena Hard Prompts—1104
LiveBench Data Analysis37.9%—
BIG-Bench Hard—71.7%
Epoch Capabilities Index—117.39
LiveBench46.9%—

Math Sonar leads

Sonar: 33.7 (#200), Yi-34B: 21.6 (#282)

Math benchmarks
BenchmarkSonarYi-34B
LiveBench Math41.6%—
LMArena Math—1114
MATH Level 5—5.1%
GSM8K—76%

Knowledge Not comparable

Sonar: —, Yi-34B: 7.5 (#309)

Knowledge benchmarks
BenchmarkSonarYi-34B
GPQA Diamond—14.7%
LMArena Expert—1061
MMLU—76.3%

Multilingual Not comparable

Sonar: —, Yi-34B: 29.7 (#264)

Multilingual benchmarks
BenchmarkSonarYi-34B
LMArena Non-English—1079
LMArena Chinese—1176
LMArena French—1081
LMArena German—1042
LMArena Japanese—993
LMArena Korean—959
LMArena Russian—1050
LMArena Spanish—1070

Instruction Following Sonar leads

Sonar: 71.4 (#150), Yi-34B: 56.2 (#274)

Instruction Following benchmarks
BenchmarkSonarYi-34B
LiveBench Instruction Following76.2%—
LMArena Instruction Following—1091

Long Context Not comparable

Sonar: —, Yi-34B: 33.2 (#264)

Long Context benchmarks
BenchmarkSonarYi-34B
LMArena Longer Query—1094

Writing & Preference Sonar leads

Sonar: 52.6 (#167), Yi-34B: 34.1 (#273)

Writing & Preference benchmarks
BenchmarkSonarYi-34B
LMArena Text—1129
LMArena Creative Writing—1108
LMArena Multi-Turn—1113
LiveBench Language44.1%—

Frequently asked questions

Is Sonar better than Yi-34B?

Sonar is the stronger model overall, scoring 38.5 to 27.8 on the Noometry Index.

Is Sonar or Yi-34B better for coding?

Sonar scores higher on coding benchmarks: 35.7 versus 32.3 in the Noometry coding category.

How many benchmarks do Sonar and Yi-34B share?

0 benchmarks have published results for both models. Sonar has 7 scored results on Noometry and Yi-34B has 23.

Related comparisons

Go deeper