Model comparison
DBRX vs Sonar
Sonar is the stronger model overall, scoring 38.5 to 29.4 on the Noometry Index.
Last verified . 0 shared benchmarks.
Summary
- The widest gap is in writing & preference, where Sonar leads 52.6 to 33.6.
- DBRX has downloadable open weights; the other is API-only.
Side by side
| DBRX | Sonar | |
|---|---|---|
| Provider | Databricks | Perplexity |
| Noometry Index | 29.4 | 38.5 |
| Released | 2024-03-27 | 2024-01-01 |
| Weights | Open | Proprietary |
| Context window | — | 128K |
| Max output | — | 4K |
| Input $ / M tokens | — | $1 |
| Output $ / M tokens | — | $1 |
| Results tracked | 21 | 7 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Sonar leads
DBRX: 32.9 (#266), Sonar: 35.7 (#221)
| Benchmark | DBRX | Sonar |
|---|---|---|
| LiveBench Coding | — | 35.1% |
| LMArena Coding | 1132 | — |
| HumanEval+ | 70.1% | — |
| MBPP+ | 55.8% | — |
Reasoning Too close to call
DBRX: 21.4 (#222), Sonar: 21.1 (#227)
| Benchmark | DBRX | Sonar |
|---|---|---|
| LiveBench Reasoning | — | 46.3% |
| LMArena Hard Prompts | 1113 | — |
| LiveBench Data Analysis | — | 37.9% |
| LiveBench | — | 46.9% |
Math Sonar leads
DBRX: 24.3 (#269), Sonar: 33.7 (#200)
| Benchmark | DBRX | Sonar |
|---|---|---|
| LiveBench Math | — | 41.6% |
| LMArena Math | 1145 | — |
| MATH Level 5 | 11.7% | — |
Knowledge Not comparable
DBRX: 14.9 (#294), Sonar: —
| Benchmark | DBRX | Sonar |
|---|---|---|
| GPQA Diamond | 32.9% | — |
| LMArena Expert | 1076 | — |
Multilingual Not comparable
DBRX: 29.3 (#268), Sonar: —
| Benchmark | DBRX | Sonar |
|---|---|---|
| LMArena Non-English | 1071 | — |
| LMArena Chinese | 1068 | — |
| LMArena French | 1096 | — |
| LMArena German | 1057 | — |
| LMArena Japanese | 990 | — |
| LMArena Korean | 993 | — |
| LMArena Russian | 1078 | — |
| LMArena Spanish | 1064 | — |
Instruction Following Sonar leads
DBRX: 57.5 (#270), Sonar: 71.4 (#150)
| Benchmark | DBRX | Sonar |
|---|---|---|
| LiveBench Instruction Following | — | 76.2% |
| LMArena Instruction Following | 1112 | — |
Long Context Not comparable
DBRX: 33.7 (#258), Sonar: —
| Benchmark | DBRX | Sonar |
|---|---|---|
| LMArena Longer Query | 1112 | — |
Writing & Preference Sonar leads
DBRX: 33.6 (#275), Sonar: 52.6 (#167)
| Benchmark | DBRX | Sonar |
|---|---|---|
| LMArena Text | 1119 | — |
| LMArena Creative Writing | 1104 | — |
| LMArena Multi-Turn | 1111 | — |
| LiveBench Language | — | 44.1% |
Frequently asked questions
Is DBRX better than Sonar?
Sonar is the stronger model overall, scoring 38.5 to 29.4 on the Noometry Index.
Is DBRX or Sonar better for coding?
Sonar scores higher on coding benchmarks: 35.7 versus 32.9 in the Noometry coding category.
How many benchmarks do DBRX and Sonar share?
0 benchmarks have published results for both models. DBRX has 21 scored results on Noometry and Sonar has 7.