Model comparison

DBRX vs Gemma 4 26B A4B IT

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.1 to 29.0 on the Noometry Index.

Last verified . 15 shared benchmarks.

DBRX Databricks

29.0

Rank #307 Confirmed

Gemma 4 26B A4B IT Google

43.1

Rank #88 Confirmed

Summary

  • They share 15 benchmarks with published results for both. DBRX scores higher in 0 categories and Gemma 4 26B A4B IT in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemma 4 26B A4B IT leads 45.6 to 14.9.
  • The biggest single-benchmark swing is GPQA Diamond: 32.9% for DBRX and 73.2% for Gemma 4 26B A4B IT.

Side by side

DBRX and Gemma 4 26B A4B IT specifications
DBRXGemma 4 26B A4B IT
ProviderDatabricksGoogle
Noometry Index29.043.1
Released2024-03-272026-04-02
WeightsOpenOpen
Context window—262K
Max output—33K
Input $ / M tokens—$0.0765
Output $ / M tokens—$0.26
Results tracked2128

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 4 26B A4B IT leads

DBRX: 32.3 (#262), Gemma 4 26B A4B IT: 38.8 (#156)

Coding benchmarks
BenchmarkDBRXGemma 4 26B A4B IT
LMArena Coding11321446
LMArena WebDev—1359
SciCode—40%
WeirdML—35.2%
ALE-Bench—927.17
HumanEval+70.1%—
MBPP+55.8%—

Reasoning Too close to call

DBRX: 20.5 (#218), Gemma 4 26B A4B IT: 21.1 (#205)

Reasoning benchmarks
BenchmarkDBRXGemma 4 26B A4B IT
LMArena Hard Prompts11131438
CritPt—0%
Chess Puzzles—6%
DTBench—74.9%
LMCA—29.7%
Epoch Capabilities Index—141.85

Math Gemma 4 26B A4B IT leads

DBRX: 22.3 (#265), Gemma 4 26B A4B IT: 45.7 (#61)

Math benchmarks
BenchmarkDBRXGemma 4 26B A4B IT
LMArena Math11451469
OTIS Mock AIME 2024-2025—82.2%
MATH Level 511.7%—

Knowledge Gemma 4 26B A4B IT leads

DBRX: 14.9 (#289), Gemma 4 26B A4B IT: 45.6 (#79)

Knowledge benchmarks
BenchmarkDBRXGemma 4 26B A4B IT
GPQA Diamond32.9%73.2%
LMArena Expert10761447
Vectara Hallucination Rate—5.2%

Multimodal Not comparable

DBRX: —, Gemma 4 26B A4B IT: 39.9 (#43)

Multimodal benchmarks
BenchmarkDBRXGemma 4 26B A4B IT
LMArena Vision—1260

Multilingual Gemma 4 26B A4B IT leads

DBRX: 29.4 (#263), Gemma 4 26B A4B IT: 53.3 (#68)

Multilingual benchmarks
BenchmarkDBRXGemma 4 26B A4B IT
LMArena Non-English10711422
LMArena Chinese10681495
LMArena French10951459
LMArena Russian10781434
LMArena Spanish10641415
LMArena German1057—
LMArena Japanese990—
LMArena Korean993—

Instruction Following Gemma 4 26B A4B IT leads

DBRX: 57.7 (#265), Gemma 4 26B A4B IT: 75.0 (#78)

Instruction Following benchmarks
BenchmarkDBRXGemma 4 26B A4B IT
LMArena Instruction Following11121420

Long Context Gemma 4 26B A4B IT leads

DBRX: 33.7 (#253), Gemma 4 26B A4B IT: 43.6 (#87)

Long Context benchmarks
BenchmarkDBRXGemma 4 26B A4B IT
LMArena Longer Query11121427

Writing & Preference Gemma 4 26B A4B IT leads

DBRX: 33.7 (#271), Gemma 4 26B A4B IT: 58.8 (#110)

Writing & Preference benchmarks
BenchmarkDBRXGemma 4 26B A4B IT
LMArena Text11191434
LMArena Creative Writing11041401
LMArena Multi-Turn11111442
EQ-Bench Creative Writing—1305

Frequently asked questions

Is DBRX better than Gemma 4 26B A4B IT?

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.1 to 29.0 on the Noometry Index.

Is DBRX or Gemma 4 26B A4B IT better for coding?

Gemma 4 26B A4B IT scores higher on coding benchmarks: 38.8 versus 32.3 in the Noometry coding category.

How many benchmarks do DBRX and Gemma 4 26B A4B IT share?

15 benchmarks have published results for both models. DBRX has 21 scored results on Noometry and Gemma 4 26B A4B IT has 28.

Related comparisons

Go deeper