Model comparison

DBRX vs Mercury 2

Mercury 2 is the stronger model overall, scoring 39.1 to 29.4 on the Noometry Index.

Last verified . 11 shared benchmarks.

DBRX Databricks

29.4

Rank #311 Confirmed

Mercury 2 Inception

39.1

Rank #175 Confirmed

Summary

  • They share 11 benchmarks with published results for both. DBRX scores higher in 0 categories and Mercury 2 in 7 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Mercury 2 leads 36.2 to 14.9.
  • DBRX has downloadable open weights; the other is API-only.

Side by side

DBRX and Mercury 2 specifications
DBRXMercury 2
ProviderDatabricksInception
Noometry Index29.439.1
Released2024-03-272026-02-20
WeightsOpenProprietary
Context window—128K
Max output—50K
Input $ / M tokens—$0.25
Output $ / M tokens—$0.75
Results tracked2117

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

DBRX: 32.9 (#266), Mercury 2: 33.5 (#255)

Coding benchmarks
BenchmarkDBRXMercury 2
LMArena Coding11321391
LMArena WebDev—1171
SciCode—38.7%
WeirdML—43.2%
ALE-Bench—785.58
HumanEval+70.1%—
MBPP+55.8%—

Reasoning Mercury 2 leads

DBRX: 21.4 (#222), Mercury 2: 23.8 (#170)

Reasoning benchmarks
BenchmarkDBRXMercury 2
LMArena Hard Prompts11131362
CritPt—0.8%

Math Not comparable

DBRX: 24.3 (#269), Mercury 2: —

Math benchmarks
BenchmarkDBRXMercury 2
LMArena Math1145—
MATH Level 511.7%—

Knowledge Mercury 2 leads

DBRX: 14.9 (#294), Mercury 2: 36.2 (#172)

Knowledge benchmarks
BenchmarkDBRXMercury 2
LMArena Expert10761358
GPQA Diamond32.9%—
Vectara Hallucination Rate—12.3%

Multilingual Mercury 2 leads

DBRX: 29.3 (#268), Mercury 2: 46.6 (#157)

Multilingual benchmarks
BenchmarkDBRXMercury 2
LMArena Non-English10711331
LMArena Chinese10681417
LMArena Russian10781304
LMArena French1096—
LMArena German1057—
LMArena Japanese990—
LMArena Korean993—
LMArena Spanish1064—

Instruction Following Mercury 2 leads

DBRX: 57.5 (#270), Mercury 2: 70.2 (#165)

Instruction Following benchmarks
BenchmarkDBRXMercury 2
LMArena Instruction Following11121329

Long Context Mercury 2 leads

DBRX: 33.7 (#258), Mercury 2: 40.5 (#154)

Long Context benchmarks
BenchmarkDBRXMercury 2
LMArena Longer Query11121330

Writing & Preference Mercury 2 leads

DBRX: 33.6 (#275), Mercury 2: 53.8 (#155)

Writing & Preference benchmarks
BenchmarkDBRXMercury 2
LMArena Text11191355
LMArena Creative Writing11041289
LMArena Multi-Turn11111358

Frequently asked questions

Is DBRX better than Mercury 2?

Mercury 2 is the stronger model overall, scoring 39.1 to 29.4 on the Noometry Index.

Is DBRX or Mercury 2 better for coding?

They score almost the same on coding (32.9 vs 33.5); test both on your own repository before choosing.

How many benchmarks do DBRX and Mercury 2 share?

11 benchmarks have published results for both models. DBRX has 21 scored results on Noometry and Mercury 2 has 17.

Related comparisons

Go deeper