Noometry

Model comparison

Grok 3 vs Mixtral 8x7B

Grok 3 is the stronger model overall, scoring 39.6 to 26.8 on the Noometry Index.

Last verified . 25 shared benchmarks.

Grok 3 xAI

39.6

Rank #150 Confirmed

Mixtral 8x7B Mistral AI

26.8

Rank #328 Confirmed

Summary

  • They share 25 benchmarks with published results for both. Grok 3 scores higher in 7 categories and Mixtral 8x7B in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok 3 leads 46.0 to 11.0.
  • The biggest single-benchmark swing is MATH Level 5: 88.7% for Grok 3 and 10% for Mixtral 8x7B.
  • Mixtral 8x7B has downloadable open weights; the other is API-only.

Side by side

Grok 3Mixtral 8x7B
ProviderxAIMistral AI
Noometry Index39.626.8
Released2025-04-092023-12-11
WeightsProprietaryOpen
Context window—32K
Max output—32K
Input $ / M tokens—$0.70
Output $ / M tokens—$0.70
Results tracked4038

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 3 leads

Grok 3: 41.5 (#113), Mixtral 8x7B: 32.2 (#265)

BenchmarkGrok 3Mixtral 8x7B
LMArena Coding14321127
Aider Polyglot53.3%—
WeirdML37.2%—
HumanEval+—39.6%
MBPP+—49.7%

Agentic & Tool Use Not comparable

Grok 3: 30.2 (#69), Mixtral 8x7B: —

BenchmarkGrok 3Mixtral 8x7B
BALROG29.5%—

Reasoning Mixtral 8x7B leads

Grok 3: 13.8 (#322), Mixtral 8x7B: 17.4 (#283)

BenchmarkGrok 3Mixtral 8x7B
LMArena Hard Prompts14331115
Epoch Capabilities Index138.34118.38
ARC-AGI-20%—
SimpleBench36.1%—
Kagi LLM Benchmark61.3%—
ARC-AGI-15.5%—
DTBench—49.6%
Adversarial NLI—55.2%
ForecastBench—56.3
HellaSwag—86.7%
PIQA—83.6%
WinoGrande—77.2%

Math Grok 3 leads

Grok 3: 36.2 (#122), Mixtral 8x7B: 17.2 (#284)

BenchmarkGrok 3Mixtral 8x7B
Omni-MATH46.4%10.5%
LMArena Math13901147
MATH Level 588.7%10%
OTIS Mock AIME 2024-202555.6%—
FrontierMath (Feb 2025 set)3.8%—
FrontierMath Tier 4 (v1)0%—
GSM8K—74.4%

Knowledge Grok 3 leads

Grok 3: 46.0 (#76), Mixtral 8x7B: 11.0 (#296)

BenchmarkGrok 3Mixtral 8x7B
GPQA Diamond75.8%30.6%
MMLU-Pro78.8%33.5%
GPQA (HELM)65%29.6%
LMArena Expert14201088
Confabulations14.2%—
Vectara Hallucination Rate5.8%—
ARC (AI2) Challenge—87.3%
MMLU—70.6%
OpenBookQA—85.8%
TriviaQA—82.2%

Multilingual Grok 3 leads

Grok 3: 52.5 (#81), Mixtral 8x7B: 29.8 (#261)

BenchmarkGrok 3Mixtral 8x7B
LMArena Non-English14111077
LMArena Chinese14481055
LMArena French14601165
LMArena German14311114
LMArena Japanese1389931
LMArena Korean1374968
LMArena Russian14161090
LMArena Spanish14171110

Instruction Following Grok 3 leads

Grok 3: 75.2 (#69), Mixtral 8x7B: 51.2 (#292)

BenchmarkGrok 3Mixtral 8x7B
IFEval88.4%57.5%
LMArena Instruction Following14091110

Long Context Grok 3 leads

Grok 3: 38.7 (#187), Mixtral 8x7B: 33.4 (#255)

BenchmarkGrok 3Mixtral 8x7B
LMArena Longer Query14391103
Fiction.LiveBench58.3%—

Writing & Preference Grok 3 leads

Grok 3: 56.0 (#136), Mixtral 8x7B: 34.4 (#265)

BenchmarkGrok 3Mixtral 8x7B
LMArena Text14261132
LMArena Creative Writing14141109
WildBench84.9%67.3%
LMArena Multi-Turn14241115
Short-Story Creative Writing76.4%—
EQ-Bench Creative Writing1186—

Frequently asked questions

Is Grok 3 better than Mixtral 8x7B?

Grok 3 is the stronger model overall, scoring 39.6 to 26.8 on the Noometry Index.

Is Grok 3 or Mixtral 8x7B better for coding?

Grok 3 scores higher on coding benchmarks: 41.5 versus 32.2 in the Noometry coding category.

How many benchmarks do Grok 3 and Mixtral 8x7B share?

25 benchmarks have published results for both models. Grok 3 has 40 scored results on Noometry and Mixtral 8x7B has 38.

Related comparisons

Go deeper