Model comparison

Grok Build 0.1 vs Mistral Small 3

Grok Build 0.1 is the stronger model overall, scoring 35.8 to 30.9 on the Noometry Index. Mistral Small 3 costs 22× less per token, which makes it the better buy when Grok Build 0.1's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Grok Build 0.1 xAI

35.8

Rank #214 Reported

Mistral Small 3 Mistral AI

30.9

Rank #268 Confirmed

Summary

  • The widest gap is in reasoning, where Grok Build 0.1 leads 31.3 to 18.2.
  • Mistral Small 3 is cheaper at $0.05 / $0.08 per million input/output tokens, against $1 / $2 for Grok Build 0.1.
  • Grok Build 0.1 accepts more context: 256K tokens versus 33K.
  • Mistral Small 3 has downloadable open weights; the other is API-only.

Side by side

Grok Build 0.1 and Mistral Small 3 specifications
Grok Build 0.1Mistral Small 3
ProviderxAIMistral AI
Noometry Index35.830.9
Released2026-04-162025-01-30
WeightsProprietaryOpen
Context window256K33K
Max output256K16K
Input $ / M tokens$1$0.05
Output $ / M tokens$2$0.08
Results tracked324

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok Build 0.1 leads

Grok Build 0.1: 42.5 (#90), Mistral Small 3: 36.0 (#203)

Coding benchmarks
BenchmarkGrok Build 0.1Mistral Small 3
SciCode50.2%—
BigCodeBench Instruct—45.3%
LMArena Coding—1246
BigCodeBench Complete—50.4%

Agentic & Tool Use Not comparable

Grok Build 0.1: 22.5 (#122), Mistral Small 3: —

Agentic & Tool Use benchmarks
BenchmarkGrok Build 0.1Mistral Small 3
GBAEval2.4%—

Reasoning Grok Build 0.1 leads

Grok Build 0.1: 31.3 (#73), Mistral Small 3: 18.2 (#269)

Reasoning benchmarks
BenchmarkGrok Build 0.1Mistral Small 3
CritPt9.1%—
Chess Puzzles—0%
LMArena Hard Prompts—1233
Epoch Capabilities Index—127.06

Math Not comparable

Grok Build 0.1: —, Mistral Small 3: 15.3 (#290)

Math benchmarks
BenchmarkGrok Build 0.1Mistral Small 3
OTIS Mock AIME 2024-2025—6.7%
LMArena Math—1240

Knowledge Not comparable

Grok Build 0.1: —, Mistral Small 3: 25.0 (#258)

Knowledge benchmarks
BenchmarkGrok Build 0.1Mistral Small 3
GPQA Diamond—47.3%
Confabulations—25.2%
LMArena Expert—1202

Multilingual Not comparable

Grok Build 0.1: —, Mistral Small 3: 37.5 (#231)

Multilingual benchmarks
BenchmarkGrok Build 0.1Mistral Small 3
LMArena Non-English—1198
LMArena Chinese—1204
LMArena French—1202
LMArena German—1211
LMArena Japanese—1111
LMArena Korean—1188
LMArena Russian—1216

Instruction Following Not comparable

Grok Build 0.1: —, Mistral Small 3: 63.9 (#224)

Instruction Following benchmarks
BenchmarkGrok Build 0.1Mistral Small 3
LMArena Instruction Following—1214

Long Context Not comparable

Grok Build 0.1: —, Mistral Small 3: 37.8 (#206)

Long Context benchmarks
BenchmarkGrok Build 0.1Mistral Small 3
LMArena Longer Query—1246

Writing & Preference Not comparable

Grok Build 0.1: —, Mistral Small 3: 32.4 (#275)

Writing & Preference benchmarks
BenchmarkGrok Build 0.1Mistral Small 3
LMArena Text—1234
LMArena Creative Writing—1195
EQ-Bench Creative Writing—707
LMArena Multi-Turn—1217

Frequently asked questions

Is Grok Build 0.1 better than Mistral Small 3?

Grok Build 0.1 is the stronger model overall, scoring 35.8 to 30.9 on the Noometry Index. Mistral Small 3 costs 22× less per token, which makes it the better buy when Grok Build 0.1's lead doesn't matter for your workload.

Which is cheaper, Grok Build 0.1 or Mistral Small 3?

Mistral Small 3 is cheaper. It lists at $0.05 per million input tokens and $0.08 per million output tokens; Grok Build 0.1 lists at $1 and $2.

Is Grok Build 0.1 or Mistral Small 3 better for coding?

Grok Build 0.1 scores higher on coding benchmarks: 42.5 versus 36.0 in the Noometry coding category.

Which has the bigger context window?

Grok Build 0.1 does, with 256K tokens against 33K.

How many benchmarks do Grok Build 0.1 and Mistral Small 3 share?

0 benchmarks have published results for both models. Grok Build 0.1 has 3 scored results on Noometry and Mistral Small 3 has 24.

Related comparisons

Go deeper