Noometry

Model comparison

DBRX vs Gemini 2.5 Flash

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 29.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

DBRX Databricks

29.4

Rank #311 Confirmed

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Summary

  • They share 17 benchmarks with published results for both. DBRX scores higher in 1 category and Gemini 2.5 Flash in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Gemini 2.5 Flash leads 52.3 to 29.3.
  • DBRX has downloadable open weights; the other is API-only.

Side by side

DBRXGemini 2.5 Flash
ProviderDatabricksGoogle
Noometry Index29.439.3
Released2024-03-272025-04-17
WeightsOpenProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.30
Output $ / M tokens—$2.50
Results tracked2154

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash leads

DBRX: 32.9 (#266), Gemini 2.5 Flash: 35.8 (#220)

BenchmarkDBRXGemini 2.5 Flash
LMArena Coding11321424
SWE-bench Verified (bash only)—28.7%
Aider Polyglot—55.1%
WeirdML—41.9%
ALE-Bench—661.88
HumanEval+70.1%—
MBPP+55.8%—

Agentic & Tool Use Not comparable

DBRX: —, Gemini 2.5 Flash: 30.8 (#74)

BenchmarkDBRXGemini 2.5 Flash
Terminal-Bench—17.1%
Berkeley Function Calling Leaderboard—56.2%
TheAgentCompany—41.1%
BALROG—33.5%
Vending-Bench 2—548.84

Reasoning DBRX leads

DBRX: 21.4 (#222), Gemini 2.5 Flash: 18.1 (#286)

BenchmarkDBRXGemini 2.5 Flash
LMArena Hard Prompts11131422
ARC-AGI-2—2.5%
SimpleBench—41.2%
Kagi LLM Benchmark—56.8%
ARC-AGI-1—33.3%
CritPt—1.1%
EnigmaEval—2.7%
DTBench—76.5%
LMCA—27.5%
Epoch Capabilities Index—143.03
ForecastBench—60.6

Math Gemini 2.5 Flash leads

DBRX: 24.3 (#269), Gemini 2.5 Flash: 39.9 (#98)

BenchmarkDBRXGemini 2.5 Flash
LMArena Math11451415
OTIS Mock AIME 2024-2025—73.1%
Omni-MATH—38.5%
MATH Level 511.7%—
FrontierMath (Feb 2025 set)—4.8%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Gemini 2.5 Flash leads

DBRX: 14.9 (#294), Gemini 2.5 Flash: 36.4 (#168)

BenchmarkDBRXGemini 2.5 Flash
LMArena Expert10761426
GPQA Diamond32.9%—
Humanity's Last Exam—12.1%
MMLU-Pro—63.9%
Confabulations—16.8%
Vectara Hallucination Rate—7.8%
GPQA (HELM)—39%

Multimodal Not comparable

DBRX: —, Gemini 2.5 Flash: 41.8 (#32)

BenchmarkDBRXGemini 2.5 Flash
LMArena Vision—1253
GeoBench—76%
VPCT—46.2%
SpatialViz-Bench—36.9%

Multilingual Gemini 2.5 Flash leads

DBRX: 29.3 (#268), Gemini 2.5 Flash: 52.3 (#88)

BenchmarkDBRXGemini 2.5 Flash
LMArena Non-English10711409
LMArena Chinese10681450
LMArena French10961433
LMArena German10571418
LMArena Japanese9901405
LMArena Korean9931385
LMArena Russian10781415
LMArena Spanish10641421

Instruction Following Gemini 2.5 Flash leads

DBRX: 57.5 (#270), Gemini 2.5 Flash: 75.7 (#54)

BenchmarkDBRXGemini 2.5 Flash
LMArena Instruction Following11121405
IFEval—89.8%

Long Context Gemini 2.5 Flash leads

DBRX: 33.7 (#258), Gemini 2.5 Flash: 47.5 (#17)

BenchmarkDBRXGemini 2.5 Flash
LMArena Longer Query11121419
Fiction.LiveBench—77.8%

Writing & Preference Gemini 2.5 Flash leads

DBRX: 33.6 (#275), Gemini 2.5 Flash: 53.8 (#157)

BenchmarkDBRXGemini 2.5 Flash
LMArena Text11191417
LMArena Creative Writing11041400
LMArena Multi-Turn11111408
Short-Story Creative Writing—76.5%
EQ-Bench Creative Writing—1137
WildBench—81.7%

Frequently asked questions

Is DBRX better than Gemini 2.5 Flash?

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 29.4 on the Noometry Index.

Is DBRX or Gemini 2.5 Flash better for coding?

Gemini 2.5 Flash scores higher on coding benchmarks: 35.8 versus 32.9 in the Noometry coding category.

How many benchmarks do DBRX and Gemini 2.5 Flash share?

17 benchmarks have published results for both models. DBRX has 21 scored results on Noometry and Gemini 2.5 Flash has 54.

Related comparisons

Go deeper