Noometry

Model comparison

DBRX vs Mistral Small 3

Mistral Small 3 is the stronger model overall, scoring 31.2 to 29.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

DBRX Databricks

29.4

Rank #311 Confirmed

Mistral Small 3 Mistral AI

31.2

Rank #278 Confirmed

Summary

  • They share 17 benchmarks with published results for both. DBRX scores higher in 3 categories and Mistral Small 3 in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Mistral Small 3 leads 25.1 to 14.9.
  • The biggest single-benchmark swing is GPQA Diamond: 32.9% for DBRX and 47.3% for Mistral Small 3.

Side by side

DBRXMistral Small 3
ProviderDatabricksMistral AI
Noometry Index29.431.2
Released2024-03-272025-01-30
WeightsOpenOpen
Context window—33K
Max output—16K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.08
Results tracked2124

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3 leads

DBRX: 32.9 (#266), Mistral Small 3: 36.5 (#207)

BenchmarkDBRXMistral Small 3
LMArena Coding11321246
BigCodeBench Instruct—45.3%
BigCodeBench Complete—50.4%
HumanEval+70.1%—
MBPP+55.8%—

Reasoning DBRX leads

DBRX: 21.4 (#222), Mistral Small 3: 18.9 (#273)

BenchmarkDBRXMistral Small 3
LMArena Hard Prompts11131233
Chess Puzzles—0%
Epoch Capabilities Index—127.07

Math DBRX leads

DBRX: 24.3 (#269), Mistral Small 3: 16.3 (#295)

BenchmarkDBRXMistral Small 3
LMArena Math11451240
OTIS Mock AIME 2024-2025—6.7%
MATH Level 511.7%—

Knowledge Mistral Small 3 leads

DBRX: 14.9 (#294), Mistral Small 3: 25.1 (#263)

BenchmarkDBRXMistral Small 3
GPQA Diamond32.9%47.3%
LMArena Expert10761202
Confabulations—25.2%

Multilingual Mistral Small 3 leads

DBRX: 29.3 (#268), Mistral Small 3: 37.3 (#236)

BenchmarkDBRXMistral Small 3
LMArena Non-English10711198
LMArena Chinese10681204
LMArena French10961203
LMArena German10571211
LMArena Japanese9901111
LMArena Korean9931188
LMArena Russian10781216
LMArena Spanish1064—

Instruction Following Mistral Small 3 leads

DBRX: 57.5 (#270), Mistral Small 3: 63.7 (#229)

BenchmarkDBRXMistral Small 3
LMArena Instruction Following11121214

Long Context Mistral Small 3 leads

DBRX: 33.7 (#258), Mistral Small 3: 37.8 (#211)

BenchmarkDBRXMistral Small 3
LMArena Longer Query11121246

Writing & Preference DBRX leads

DBRX: 33.6 (#275), Mistral Small 3: 32.2 (#280)

BenchmarkDBRXMistral Small 3
LMArena Text11191234
LMArena Creative Writing11041195
LMArena Multi-Turn11111217
EQ-Bench Creative Writing—707

Frequently asked questions

Is DBRX better than Mistral Small 3?

Mistral Small 3 is the stronger model overall, scoring 31.2 to 29.4 on the Noometry Index.

Is DBRX or Mistral Small 3 better for coding?

Mistral Small 3 scores higher on coding benchmarks: 36.5 versus 32.9 in the Noometry coding category.

How many benchmarks do DBRX and Mistral Small 3 share?

17 benchmarks have published results for both models. DBRX has 21 scored results on Noometry and Mistral Small 3 has 24.

Related comparisons

Go deeper