Noometry

Model comparison

DBRX vs o3-mini

o3-mini is the stronger model overall, scoring 36.7 to 29.0 on the Noometry Index.

Last verified . 19 shared benchmarks.

DBRX Databricks

29.0

Rank #307 Confirmed

o3-mini OpenAI

36.7

Rank #205 Confirmed

Summary

  • They share 19 benchmarks with published results for both. DBRX scores higher in 1 category and o3-mini in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where o3-mini leads 38.3 to 14.9.
  • The biggest single-benchmark swing is MATH Level 5: 11.7% for DBRX and 96.5% for o3-mini.
  • DBRX has downloadable open weights; the other is API-only.

Side by side

DBRXo3-mini
ProviderDatabricksOpenAI
Noometry Index29.036.7
Released2024-03-272024-12-20
WeightsOpenProprietary
Context window—200K
Max output—100K
Input $ / M tokens—$1.10
Output $ / M tokens—$4.40
Results tracked2151

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3-mini leads

DBRX: 32.3 (#262), o3-mini: 41.4 (#116)

BenchmarkDBRXo3-mini
LMArena Coding11321378
Aider Polyglot—60.4%
SciCode—39.8%
GSO—1.3%
WeirdML—43.7%
LiveBench Coding—82.7%
CadEval—54%
HumanEval+70.1%—
MBPP+55.8%—

Agentic & Tool Use Not comparable

DBRX: —, o3-mini: 29.3 (#79)

BenchmarkDBRXo3-mini
Cybench—22.5%

Reasoning DBRX leads

DBRX: 20.5 (#218), o3-mini: 16.3 (#295)

BenchmarkDBRXo3-mini
LMArena Hard Prompts11131366
ARC-AGI-2—3%
SimpleBench—22.8%
ARC-AGI-1—34.5%
CritPt—0.3%
Chess Puzzles—17%
LiveBench Reasoning—89.6%
Mystery Game Puzzles—7%
DTBench—68.8%
LiveBench Data Analysis—70.6%
LMCA—19%
Epoch Capabilities Index—140.35
ForecastBench—59.6
LiveBench—75.9%

Math o3-mini leads

DBRX: 22.3 (#265), o3-mini: 27.6 (#236)

BenchmarkDBRXo3-mini
LMArena Math11451396
MATH Level 511.7%96.5%
FrontierMath (Tiers 1-3)—18.6%
FrontierMath Tier 4—0%
OTIS Mock AIME 2024-2025—76.9%
LiveBench Math—77.3%
FrontierMath (Feb 2025 set)—12.4%
FrontierMath Tier 4 (v1)—4.2%

Knowledge o3-mini leads

DBRX: 14.9 (#289), o3-mini: 38.3 (#135)

BenchmarkDBRXo3-mini
GPQA Diamond32.9%77%
LMArena Expert10761364
SimpleQA Verified—15.3%
Confabulations—17.9%

Multilingual o3-mini leads

DBRX: 29.4 (#263), o3-mini: 45.9 (#159)

BenchmarkDBRXo3-mini
LMArena Non-English10711319
LMArena Chinese10681379
LMArena French10951333
LMArena German10571303
LMArena Japanese9901286
LMArena Korean9931314
LMArena Russian10781304
LMArena Spanish10641321

Instruction Following o3-mini leads

DBRX: 57.7 (#265), o3-mini: 75.3 (#67)

BenchmarkDBRXo3-mini
LMArena Instruction Following11121338
LiveBench Instruction Following—84.4%

Long Context Too close to call

DBRX: 33.7 (#253), o3-mini: 33.8 (#251)

BenchmarkDBRXo3-mini
LMArena Longer Query11121343
Fiction.LiveBench—50%

Writing & Preference o3-mini leads

DBRX: 33.7 (#271), o3-mini: 50.4 (#177)

BenchmarkDBRXo3-mini
LMArena Text11191337
LMArena Creative Writing11041286
LMArena Multi-Turn11111320
Short-Story Creative Writing—61.7%
LiveBench Language—50.7%

Frequently asked questions

Is DBRX better than o3-mini?

o3-mini is the stronger model overall, scoring 36.7 to 29.0 on the Noometry Index.

Is DBRX or o3-mini better for coding?

o3-mini scores higher on coding benchmarks: 41.4 versus 32.3 in the Noometry coding category.

How many benchmarks do DBRX and o3-mini share?

19 benchmarks have published results for both models. DBRX has 21 scored results on Noometry and o3-mini has 51.

Related comparisons

Go deeper