Model comparison

Claude Sonnet 4 vs DBRX

Claude Sonnet 4 is the stronger model overall, scoring 40.8 to 29.4 on the Noometry Index.

Last verified . 19 shared benchmarks.

Claude Sonnet 4 Anthropic

40.8

Rank #145 Confirmed

DBRX Databricks

29.4

Rank #311 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Claude Sonnet 4 scores higher in 7 categories and DBRX in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude Sonnet 4 leads 41.8 to 14.9.
  • The biggest single-benchmark swing is MATH Level 5: 84.4% for Claude Sonnet 4 and 11.7% for DBRX.
  • DBRX has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 4 and DBRX specifications
Claude Sonnet 4DBRX
ProviderAnthropicDatabricks
Noometry Index40.829.4
Released2025-05-222024-03-27
WeightsProprietaryOpen
Context window200K—
Max output64K—
Input $ / M tokens$3—
Output $ / M tokens$15—
Results tracked5821

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 4 leads

Claude Sonnet 4: 43.5 (#88), DBRX: 32.9 (#266)

Coding benchmarks
BenchmarkClaude Sonnet 4DBRX
LMArena Coding14141132
SWE-bench Verified (bash only)64.9%—
Aider Polyglot61.3%—
SciCode40%—
GSO4.9%—
WeirdML46.1%—
ALE-Bench655.35—
HumanEval+—70.1%
MBPP+—55.8%

Agentic & Tool Use Not comparable

Claude Sonnet 4: 38.5 (#31), DBRX: —

Agentic & Tool Use benchmarks
BenchmarkClaude Sonnet 4DBRX
TheAgentCompany33.1%—
Cybench35%—
DeepResearch Bench46.6%—
OSWorld43.9%—
METR Time Horizons62%—

Reasoning Claude Sonnet 4 leads

Claude Sonnet 4: 22.9 (#187), DBRX: 21.4 (#222)

Reasoning benchmarks
BenchmarkClaude Sonnet 4DBRX
LMArena Hard Prompts13721113
ARC-AGI-25.9%—
SimpleBench45.5%—
Kagi LLM Benchmark73%—
ARC-AGI-140%—
CritPt0.3%—
EnigmaEval3.1%—
DTBench77.1%—
LMCA29%—
Epoch Capabilities Index141.69—
ForecastBench60.2—

Math Claude Sonnet 4 leads

Claude Sonnet 4: 43.3 (#80), DBRX: 24.3 (#269)

Math benchmarks
BenchmarkClaude Sonnet 4DBRX
LMArena Math13751145
MATH Level 584.4%11.7%
OTIS Mock AIME 2024-202571.1%—
Omni-MATH60.2%—
FrontierMath (Feb 2025 set)4.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Claude Sonnet 4 leads

Claude Sonnet 4: 41.8 (#108), DBRX: 14.9 (#294)

Knowledge benchmarks
BenchmarkClaude Sonnet 4DBRX
GPQA Diamond79.2%32.9%
LMArena Expert13721076
Humanity's Last Exam7.8%—
MMLU-Pro84.3%—
Confabulations13.2%—
Vectara Hallucination Rate10.3%—
GPQA (HELM)70.6%—

Multimodal Not comparable

Claude Sonnet 4: 26.2 (#121), DBRX: —

Multimodal benchmarks
BenchmarkClaude Sonnet 4DBRX
LMArena Vision1191—
GeoBench37%—
VPCT34%—
MindCube44.8%—

Multilingual Claude Sonnet 4 leads

Claude Sonnet 4: 46.7 (#156), DBRX: 29.3 (#268)

Multilingual benchmarks
BenchmarkClaude Sonnet 4DBRX
LMArena Non-English13331071
LMArena Chinese13501068
LMArena French13631096
LMArena German13311057
LMArena Japanese1302990
LMArena Korean1291993
LMArena Russian13551078
LMArena Spanish13571064

Instruction Following Claude Sonnet 4 leads

Claude Sonnet 4: 71.7 (#145), DBRX: 57.5 (#270)

Instruction Following benchmarks
BenchmarkClaude Sonnet 4DBRX
LMArena Instruction Following13761112
IFEval84%—

Long Context Too close to call

Claude Sonnet 4: 33.7 (#259), DBRX: 33.7 (#258)

Long Context benchmarks
BenchmarkClaude Sonnet 4DBRX
LMArena Longer Query13981112
Fiction.LiveBench46.9%—

Writing & Preference Claude Sonnet 4 leads

Claude Sonnet 4: 57.1 (#132), DBRX: 33.6 (#275)

Writing & Preference benchmarks
BenchmarkClaude Sonnet 4DBRX
LMArena Text13511119
LMArena Creative Writing13451104
LMArena Multi-Turn13761111
Short-Story Creative Writing81.4%—
EQ-Bench Creative Writing1483—
WildBench83.8%—

Frequently asked questions

Is Claude Sonnet 4 better than DBRX?

Claude Sonnet 4 is the stronger model overall, scoring 40.8 to 29.4 on the Noometry Index.

Is Claude Sonnet 4 or DBRX better for coding?

Claude Sonnet 4 scores higher on coding benchmarks: 43.5 versus 32.9 in the Noometry coding category.

How many benchmarks do Claude Sonnet 4 and DBRX share?

19 benchmarks have published results for both models. Claude Sonnet 4 has 58 scored results on Noometry and DBRX has 21.

Related comparisons

Go deeper