Noometry

Model comparison

Grok Build 0.1 vs Mistral Small 3.1

Grok Build 0.1 is the stronger model overall, scoring 35.8 to 31.4 on the Noometry Index. Mistral Small 3.1 costs 3.1× less per token, which makes it the better buy when Grok Build 0.1's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Grok Build 0.1 xAI

35.8

Rank #214 Reported

Mistral Small 3.1 Mistral AI

31.4

Rank #263 Confirmed

Summary

  • The widest gap is in reasoning, where Grok Build 0.1 leads 31.3 to 18.9.
  • Mistral Small 3.1 is cheaper at $0.35 / $0.56 per million input/output tokens, against $1 / $2 for Grok Build 0.1.
  • Grok Build 0.1 accepts more context: 256K tokens versus 128K.
  • Mistral Small 3.1 has downloadable open weights; the other is API-only.

Side by side

Grok Build 0.1Mistral Small 3.1
ProviderxAIMistral AI
Noometry Index35.831.4
Released2026-04-162025-03-17
WeightsProprietaryOpen
Context window256K128K
Max output256K102K
Input $ / M tokens$1$0.35
Output $ / M tokens$2$0.56
Results tracked328

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok Build 0.1 leads

Grok Build 0.1: 42.5 (#90), Mistral Small 3.1: 37.7 (#175)

BenchmarkGrok Build 0.1Mistral Small 3.1
SciCode50.2%—
LMArena Coding—1309

Agentic & Tool Use Not comparable

Grok Build 0.1: 22.5 (#122), Mistral Small 3.1: —

BenchmarkGrok Build 0.1Mistral Small 3.1
GBAEval2.4%—

Reasoning Grok Build 0.1 leads

Grok Build 0.1: 31.3 (#73), Mistral Small 3.1: 18.9 (#249)

BenchmarkGrok Build 0.1Mistral Small 3.1
CritPt9.1%—
Chess Puzzles—1%
LMArena Hard Prompts—1278
Epoch Capabilities Index—127.48

Math Not comparable

Grok Build 0.1: —, Mistral Small 3.1: 13.7 (#295)

BenchmarkGrok Build 0.1Mistral Small 3.1
OTIS Mock AIME 2024-2025—3.9%
Omni-MATH—24.8%
LMArena Math—1261

Knowledge Not comparable

Grok Build 0.1: —, Mistral Small 3.1: 22.6 (#266)

BenchmarkGrok Build 0.1Mistral Small 3.1
GPQA Diamond—41.9%
MMLU-Pro—61%
GPQA (HELM)—39.2%
LMArena Expert—1258

Multimodal Not comparable

Grok Build 0.1: —, Mistral Small 3.1: 32.6 (#93)

BenchmarkGrok Build 0.1Mistral Small 3.1
LMArena Vision—1136

Multilingual Not comparable

Grok Build 0.1: —, Mistral Small 3.1: 41.4 (#204)

BenchmarkGrok Build 0.1Mistral Small 3.1
LMArena Non-English—1255
LMArena Chinese—1254
LMArena French—1270
LMArena German—1266
LMArena Japanese—1210
LMArena Korean—1206
LMArena Russian—1263
LMArena Spanish—1283

Instruction Following Not comparable

Grok Build 0.1: —, Mistral Small 3.1: 63.8 (#225)

BenchmarkGrok Build 0.1Mistral Small 3.1
IFEval—75%
LMArena Instruction Following—1264

Long Context Not comparable

Grok Build 0.1: —, Mistral Small 3.1: 39.5 (#172)

BenchmarkGrok Build 0.1Mistral Small 3.1
LMArena Longer Query—1300

Writing & Preference Not comparable

Grok Build 0.1: —, Mistral Small 3.1: 37.2 (#254)

BenchmarkGrok Build 0.1Mistral Small 3.1
LMArena Text—1278
LMArena Creative Writing—1253
EQ-Bench Creative Writing—761
WildBench—78.8%
LMArena Multi-Turn—1270

Frequently asked questions

Is Grok Build 0.1 better than Mistral Small 3.1?

Grok Build 0.1 is the stronger model overall, scoring 35.8 to 31.4 on the Noometry Index. Mistral Small 3.1 costs 3.1× less per token, which makes it the better buy when Grok Build 0.1's lead doesn't matter for your workload.

Which is cheaper, Grok Build 0.1 or Mistral Small 3.1?

Mistral Small 3.1 is cheaper. It lists at $0.35 per million input tokens and $0.56 per million output tokens; Grok Build 0.1 lists at $1 and $2.

Is Grok Build 0.1 or Mistral Small 3.1 better for coding?

Grok Build 0.1 scores higher on coding benchmarks: 42.5 versus 37.7 in the Noometry coding category.

Which has the bigger context window?

Grok Build 0.1 does, with 256K tokens against 128K.

How many benchmarks do Grok Build 0.1 and Mistral Small 3.1 share?

0 benchmarks have published results for both models. Grok Build 0.1 has 3 scored results on Noometry and Mistral Small 3.1 has 28.

Related comparisons

Go deeper