Noometry

Model comparison

Grok 4.1 Fast vs Olmo 3 32b Think

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 38.1 on the Noometry Index.

Last verified . 14 shared benchmarks.

Grok 4.1 Fast xAI

40.9

Rank #131 Confirmed

Olmo 3 32b Think Allen Institute for AI (Ai2)

38.1

Rank #182 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Grok 4.1 Fast scores higher in 5 categories and Olmo 3 32b Think in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 42.3 to 24.9.
  • Olmo 3 32b Think has downloadable open weights; the other is API-only.

Side by side

Grok 4.1 FastOlmo 3 32b Think
ProviderxAIAllen Institute for AI (Ai2)
Noometry Index40.938.1
Released2025-06-27—
WeightsProprietaryOpen
Context window128K—
Max output30K—
Input $ / M tokens$0.20—
Output $ / M tokens$0.50—
Results tracked3214

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Olmo 3 32b Think leads

Grok 4.1 Fast: 33.8 (#236), Olmo 3 32b Think: 38.0 (#169)

BenchmarkGrok 4.1 FastOlmo 3 32b Think
LMArena Coding14111318
LMArena WebDev1241—
ALE-Bench394.93—

Agentic & Tool Use Not comparable

Grok 4.1 Fast: 36.1 (#35), Olmo 3 32b Think: —

BenchmarkGrok 4.1 FastOlmo 3 32b Think
Berkeley Function Calling Leaderboard69.6%—
τ²-bench Banking13.1%—
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 42.3 (#45), Olmo 3 32b Think: 24.9 (#138)

BenchmarkGrok 4.1 FastOlmo 3 32b Think
LMArena Hard Prompts14071302
SimpleBench56%—
NYT Connections (extended)87.4%—
DTBench87.7%—
ForecastBench61—

Math Olmo 3 32b Think leads

Grok 4.1 Fast: 30.9 (#201), Olmo 3 32b Think: 33.8 (#165)

BenchmarkGrok 4.1 FastOlmo 3 32b Think
LMArena Math14081315
MathArena Final-Answer Competitions60.9%—
ProofBench4%—

Knowledge Olmo 3 32b Think leads

Grok 4.1 Fast: 32.6 (#203), Olmo 3 32b Think: 34.4 (#189)

BenchmarkGrok 4.1 FastOlmo 3 32b Think
LMArena Expert13981272
Vectara Hallucination Rate17.8%—

Multimodal Not comparable

Grok 4.1 Fast: 36.3 (#71), Olmo 3 32b Think: —

BenchmarkGrok 4.1 FastOlmo 3 32b Think
LMArena Vision1201—

Multilingual Grok 4.1 Fast leads

Grok 4.1 Fast: 51.1 (#110), Olmo 3 32b Think: 41.4 (#205)

BenchmarkGrok 4.1 FastOlmo 3 32b Think
LMArena Non-English13911255
LMArena Chinese14411300
LMArena French14161291
LMArena German14041290
LMArena Russian13871255
LMArena Japanese1347—
LMArena Korean1361—
LMArena Spanish1411—

Instruction Following Grok 4.1 Fast leads

Grok 4.1 Fast: 72.8 (#127), Olmo 3 32b Think: 67.4 (#193)

BenchmarkGrok 4.1 FastOlmo 3 32b Think
LMArena Instruction Following13761275

Long Context Grok 4.1 Fast leads

Grok 4.1 Fast: 42.4 (#121), Olmo 3 32b Think: 39.4 (#177)

BenchmarkGrok 4.1 FastOlmo 3 32b Think
LMArena Longer Query13901296

Writing & Preference Grok 4.1 Fast leads

Grok 4.1 Fast: 57.4 (#126), Olmo 3 32b Think: 49.2 (#188)

BenchmarkGrok 4.1 FastOlmo 3 32b Think
LMArena Text14081300
LMArena Creative Writing13941256
LMArena Multi-Turn13891289
EQ-Bench Creative Writing1327—

Frequently asked questions

Is Grok 4.1 Fast better than Olmo 3 32b Think?

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 38.1 on the Noometry Index.

Is Grok 4.1 Fast or Olmo 3 32b Think better for coding?

Olmo 3 32b Think scores higher on coding benchmarks: 38.0 versus 33.8 in the Noometry coding category.

How many benchmarks do Grok 4.1 Fast and Olmo 3 32b Think share?

14 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Olmo 3 32b Think has 14.

Related comparisons

Go deeper