Model comparison

Grok Build 0.1 vs Mixtral 8x22B

Grok Build 0.1 is the stronger model overall, scoring 36.4 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Grok Build 0.1 xAI

36.4

Rank #216 Reported

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

Summary

  • The widest gap is in coding, where Grok Build 0.1 leads 43.1 to 24.2.
  • Grok Build 0.1 is cheaper at $1 / $2 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • Grok Build 0.1 accepts more context: 256K tokens versus 64K.
  • Mixtral 8x22B has downloadable open weights; the other is API-only.

Side by side

Grok Build 0.1 and Mixtral 8x22B specifications
Grok Build 0.1Mixtral 8x22B
ProviderxAIMistral AI
Noometry Index36.427.1
Released2026-04-162024-04-17
WeightsProprietaryOpen
Context window256K64K
Max output256K64K
Input $ / M tokens$1$2
Output $ / M tokens$2$6
Results tracked334

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok Build 0.1 leads

Grok Build 0.1: 43.1 (#91), Mixtral 8x22B: 24.2 (#329)

Coding benchmarks
BenchmarkGrok Build 0.1Mixtral 8x22B
SciCode50.2%—
WeirdML—3.2%
BigCodeBench Instruct—40.6%
LMArena Coding—1166
BigCodeBench Complete—50.2%
HumanEval+—72%
MBPP+—64.3%

Agentic & Tool Use Too close to call

Grok Build 0.1: 22.7 (#129), Mixtral 8x22B: 23.1 (#127)

Agentic & Tool Use benchmarks
BenchmarkGrok Build 0.1Mixtral 8x22B
Cybench—7.5%
GBAEval2.4%—

Reasoning Grok Build 0.1 leads

Grok Build 0.1: 32.2 (#77), Mixtral 8x22B: 19.9 (#248)

Reasoning benchmarks
BenchmarkGrok Build 0.1Mixtral 8x22B
CritPt9.1%—
LMArena Hard Prompts—1150
DTBench—55.1%
Epoch Capabilities Index—122.03
ForecastBench—56.3

Math Not comparable

Grok Build 0.1: —, Mixtral 8x22B: 22.9 (#275)

Math benchmarks
BenchmarkGrok Build 0.1Mixtral 8x22B
Omni-MATH—16.3%
LMArena Math—1184
MATH Level 5—24.2%

Knowledge Not comparable

Grok Build 0.1: —, Mixtral 8x22B: 15.1 (#293)

Knowledge benchmarks
BenchmarkGrok Build 0.1Mixtral 8x22B
GPQA Diamond—34.1%
MMLU-Pro—46%
GPQA (HELM)—33.4%
LMArena Expert—1113
MMLU—77.8%

Multilingual Not comparable

Grok Build 0.1: —, Mixtral 8x22B: 32.8 (#255)

Multilingual benchmarks
BenchmarkGrok Build 0.1Mixtral 8x22B
LMArena Non-English—1128
LMArena Chinese—1116
LMArena French—1166
LMArena German—1141
LMArena Japanese—1037
LMArena Korean—1057
LMArena Russian—1158
LMArena Spanish—1151

Instruction Following Not comparable

Grok Build 0.1: —, Mixtral 8x22B: 57.7 (#266)

Instruction Following benchmarks
BenchmarkGrok Build 0.1Mixtral 8x22B
IFEval—72.4%
LMArena Instruction Following—1147

Long Context Not comparable

Grok Build 0.1: —, Mixtral 8x22B: 34.7 (#247)

Long Context benchmarks
BenchmarkGrok Build 0.1Mixtral 8x22B
LMArena Longer Query—1144

Writing & Preference Not comparable

Grok Build 0.1: —, Mixtral 8x22B: 36.9 (#262)

Writing & Preference benchmarks
BenchmarkGrok Build 0.1Mixtral 8x22B
LMArena Text—1162
LMArena Creative Writing—1141
WildBench—71.1%
LMArena Multi-Turn—1130

Frequently asked questions

Is Grok Build 0.1 better than Mixtral 8x22B?

Grok Build 0.1 is the stronger model overall, scoring 36.4 to 27.1 on the Noometry Index.

Which is cheaper, Grok Build 0.1 or Mixtral 8x22B?

Grok Build 0.1 is cheaper. It lists at $1 per million input tokens and $2 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is Grok Build 0.1 or Mixtral 8x22B better for coding?

Grok Build 0.1 scores higher on coding benchmarks: 43.1 versus 24.2 in the Noometry coding category.

Which has the bigger context window?

Grok Build 0.1 does, with 256K tokens against 64K.

How many benchmarks do Grok Build 0.1 and Mixtral 8x22B share?

0 benchmarks have published results for both models. Grok Build 0.1 has 3 scored results on Noometry and Mixtral 8x22B has 34.

Related comparisons

Go deeper