Noometry

Model comparison

Claude 3.7 Sonnet vs DBRX

Claude 3.7 Sonnet is the stronger model overall, scoring 39.5 to 29.4 on the Noometry Index.

Last verified . 19 shared benchmarks.

Claude 3.7 Sonnet Anthropic

39.5

Rank #164 Confirmed

DBRX Databricks

29.4

Rank #311 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Claude 3.7 Sonnet scores higher in 7 categories and DBRX in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude 3.7 Sonnet leads 39.8 to 14.9.
  • The biggest single-benchmark swing is MATH Level 5: 91.2% for Claude 3.7 Sonnet and 11.7% for DBRX.
  • DBRX has downloadable open weights; the other is API-only.

Side by side

Claude 3.7 SonnetDBRX
ProviderAnthropicDatabricks
Noometry Index39.529.4
Released2025-02-242024-03-27
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked5821

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 40.6 (#136), DBRX: 32.9 (#266)

BenchmarkClaude 3.7 SonnetDBRX
LMArena Coding13611132
SWE-bench Verified61%—
SWE-bench Verified (bash only)52.8%—
Aider Polyglot64.9%—
GSO3.8%—
LiveBench Coding74.5%—
CadEval54%—
HumanEval+—70.1%
MBPP+—55.8%

Agentic & Tool Use Not comparable

Claude 3.7 Sonnet: 34.1 (#50), DBRX: —

BenchmarkClaude 3.7 SonnetDBRX
TheAgentCompany30.9%—
Cybench20%—
DeepResearch Bench43.6%—
OSWorld35.8%—
METR Time Horizons60%—

Reasoning DBRX leads

Claude 3.7 Sonnet: 18.6 (#277), DBRX: 21.4 (#222)

BenchmarkClaude 3.7 SonnetDBRX
LMArena Hard Prompts13331113
ARC-AGI-20.9%—
SimpleBench46.4%—
ARC-AGI-128.6%—
EnigmaEval4.2%—
LiveBench Reasoning87.8%—
LiveBench Data Analysis74%—
Epoch Capabilities Index141.16—
ForecastBench61.8—
LiveBench76.1%—

Math Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 37.5 (#153), DBRX: 24.3 (#269)

BenchmarkClaude 3.7 SonnetDBRX
LMArena Math13371145
MATH Level 591.2%11.7%
OTIS Mock AIME 2024-202557.8%—
Omni-MATH33%—
LiveBench Math79%—
FrontierMath (Feb 2025 set)4.1%—

Knowledge Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 39.8 (#130), DBRX: 14.9 (#294)

BenchmarkClaude 3.7 SonnetDBRX
GPQA Diamond79.7%32.9%
LMArena Expert13211076
Humanity's Last Exam8%—
MMLU-Pro78.4%—
Confabulations14.7%—
GPQA (HELM)60.8%—

Multimodal Not comparable

Claude 3.7 Sonnet: 33.7 (#95), DBRX: —

BenchmarkClaude 3.7 SonnetDBRX
LMArena Vision1169—
GeoBench68%—
VPCT39%—
SpatialViz-Bench33.9%—

Multilingual Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 44.1 (#179), DBRX: 29.3 (#268)

BenchmarkClaude 3.7 SonnetDBRX
LMArena Non-English12961071
LMArena Chinese12991068
LMArena French13031096
LMArena German13011057
LMArena Japanese1267990
LMArena Korean1249993
LMArena Russian13111078
LMArena Spanish12981064

Instruction Following Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 72.9 (#125), DBRX: 57.5 (#270)

BenchmarkClaude 3.7 SonnetDBRX
LMArena Instruction Following13521112
LiveBench Instruction Following81.3%—
IFEval83.4%—

Long Context Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 50.3 (#10), DBRX: 33.7 (#258)

BenchmarkClaude 3.7 SonnetDBRX
LMArena Longer Query13731112
Fiction.LiveBench83.3%—

Writing & Preference Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 54.4 (#150), DBRX: 33.6 (#275)

BenchmarkClaude 3.7 SonnetDBRX
LMArena Text13141119
LMArena Creative Writing13321104
LMArena Multi-Turn13391111
Short-Story Creative Writing81.1%—
EQ-Bench Creative Writing1412—
WildBench81.4%—
LiveBench Language59.9%—

Frequently asked questions

Is Claude 3.7 Sonnet better than DBRX?

Claude 3.7 Sonnet is the stronger model overall, scoring 39.5 to 29.4 on the Noometry Index.

Is Claude 3.7 Sonnet or DBRX better for coding?

Claude 3.7 Sonnet scores higher on coding benchmarks: 40.6 versus 32.9 in the Noometry coding category.

How many benchmarks do Claude 3.7 Sonnet and DBRX share?

19 benchmarks have published results for both models. Claude 3.7 Sonnet has 58 scored results on Noometry and DBRX has 21.

Related comparisons

Go deeper