Noometry

Model comparison

Grok 4.1 Fast vs o1-mini

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 34.0 on the Noometry Index.

Last verified . 18 shared benchmarks.

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

o1-mini OpenAI

34.0

Rank #235 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Grok 4.1 Fast scores higher in 6 categories and o1-mini in 3 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 43.4 to 8.8.
  • The biggest single-benchmark swing is SimpleBench: 56% for Grok 4.1 Fast and 18.1% for o1-mini.

Side by side

Grok 4.1 Fasto1-mini
ProviderxAIOpenAI
Noometry Index41.434.0
Released2025-06-272024-09-12
WeightsProprietaryProprietary
Context window128K—
Max output30K—
Input $ / M tokens$0.20—
Output $ / M tokens$0.50—
Results tracked3239

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o1-mini leads

Grok 4.1 Fast: 34.1 (#245), o1-mini: 35.5 (#224)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Coding14111362
Aider Polyglot—32.9%
LMArena WebDev1242—
WeirdML—36.3%
LiveBench Coding—48%
ALE-Bench394.93—
HumanEval+—89%
MBPP+—78.8%

Agentic & Tool Use Grok 4.1 Fast leads

Grok 4.1 Fast: 36.3 (#39), o1-mini: 24.6 (#118)

BenchmarkGrok 4.1 Fasto1-mini
Berkeley Function Calling Leaderboard69.6%—
τ²-bench Banking13.1%—
Cybench—10%
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 43.4 (#49), o1-mini: 8.8 (#346)

BenchmarkGrok 4.1 Fasto1-mini
SimpleBench56%18.1%
LMArena Hard Prompts14071333
ARC-AGI-2—0.8%
NYT Connections (extended)87.4%—
ARC-AGI-1—14%
LiveBench Reasoning—72.3%
DTBench87.7%—
LiveBench Data Analysis—57.9%
Epoch Capabilities Index—135.82
ForecastBench61—
LiveBench—57.8%

Math o1-mini leads

Grok 4.1 Fast: 31.9 (#221), o1-mini: 35.4 (#186)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Math14081358
MathArena Final-Answer Competitions60.9%—
OTIS Mock AIME 2024-2025—46.9%
ProofBench4%—
LiveBench Math—62%
MATH Level 5—89.2%
FrontierMath (Feb 2025 set)—1.7%

Knowledge o1-mini leads

Grok 4.1 Fast: 33.1 (#207), o1-mini: 34.9 (#192)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Expert13991316
GPQA Diamond—62.4%
Confabulations—18.6%
Vectara Hallucination Rate17.8%—

Multimodal Not comparable

Grok 4.1 Fast: 37.0 (#76), o1-mini: —

BenchmarkGrok 4.1 Fasto1-mini
LMArena Vision1201—

Multilingual Grok 4.1 Fast leads

Grok 4.1 Fast: 51.0 (#114), o1-mini: 43.6 (#182)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Non-English13911289
LMArena Chinese14411314
LMArena French14151293
LMArena German14041278
LMArena Japanese13491245
LMArena Korean13611223
LMArena Russian13871283
LMArena Spanish14131303

Instruction Following Grok 4.1 Fast leads

Grok 4.1 Fast: 72.7 (#133), o1-mini: 66.7 (#206)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Instruction Following13761304
LiveBench Instruction Following—65.4%

Long Context Grok 4.1 Fast leads

Grok 4.1 Fast: 42.4 (#126), o1-mini: 40.1 (#161)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Longer Query13901320

Writing & Preference Grok 4.1 Fast leads

Grok 4.1 Fast: 57.2 (#131), o1-mini: 48.4 (#202)

BenchmarkGrok 4.1 Fasto1-mini
LMArena Text14081317
LMArena Creative Writing13941244
LMArena Multi-Turn13891314
Short-Story Creative Writing—64.9%
EQ-Bench Creative Writing1327—
LiveBench Language—40.9%

Frequently asked questions

Is Grok 4.1 Fast better than o1-mini?

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 34.0 on the Noometry Index.

Is Grok 4.1 Fast or o1-mini better for coding?

o1-mini scores higher on coding benchmarks: 35.5 versus 34.1 in the Noometry coding category.

How many benchmarks do Grok 4.1 Fast and o1-mini share?

18 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and o1-mini has 39.

Related comparisons

Go deeper