Noometry

Model comparison

Grok 4.1 Fast vs Olmo 2 0325 32b Instruct

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 32.7 on the Noometry Index.

Last verified . 11 shared benchmarks.

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Olmo 2 0325 32b Instruct Allen Institute for AI (Ai2)

32.7

Rank #254 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Grok 4.1 Fast scores higher in 7 categories and Olmo 2 0325 32b Instruct in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 43.4 to 23.6.
  • Olmo 2 0325 32b Instruct has downloadable open weights; the other is API-only.

Side by side

Grok 4.1 FastOlmo 2 0325 32b Instruct
ProviderxAIAllen Institute for AI (Ai2)
Noometry Index41.432.7
Released2025-06-27—
WeightsProprietaryOpen
Context window128K—
Max output30K—
Input $ / M tokens$0.20—
Output $ / M tokens$0.50—
Results tracked3216

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Olmo 2 0325 32b Instruct leads

Grok 4.1 Fast: 34.1 (#245), Olmo 2 0325 32b Instruct: 35.2 (#227)

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
LMArena Coding14111210
LMArena WebDev1242—
ALE-Bench394.93—

Agentic & Tool Use Not comparable

Grok 4.1 Fast: 36.3 (#39), Olmo 2 0325 32b Instruct: —

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
Berkeley Function Calling Leaderboard69.6%—
τ²-bench Banking13.1%—
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 43.4 (#49), Olmo 2 0325 32b Instruct: 23.6 (#175)

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
LMArena Hard Prompts14071208
SimpleBench56%—
NYT Connections (extended)87.4%—
DTBench87.7%—
ForecastBench61—

Math Grok 4.1 Fast leads

Grok 4.1 Fast: 31.9 (#221), Olmo 2 0325 32b Instruct: 26.8 (#255)

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
LMArena Math14081208
MathArena Final-Answer Competitions60.9%—
ProofBench4%—
Omni-MATH—16.1%

Knowledge Grok 4.1 Fast leads

Grok 4.1 Fast: 33.1 (#207), Olmo 2 0325 32b Instruct: 19.5 (#279)

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
MMLU-Pro—41.4%
Vectara Hallucination Rate17.8%—
GPQA (HELM)—28.7%
LMArena Expert1399—

Multimodal Not comparable

Grok 4.1 Fast: 37.0 (#76), Olmo 2 0325 32b Instruct: —

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
LMArena Vision1201—

Multilingual Grok 4.1 Fast leads

Grok 4.1 Fast: 51.0 (#114), Olmo 2 0325 32b Instruct: 34.8 (#248)

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
LMArena Non-English13911160
LMArena Chinese14411192
LMArena Russian13871187
LMArena French1415—
LMArena German1404—
LMArena Japanese1349—
LMArena Korean1361—
LMArena Spanish1413—

Instruction Following Grok 4.1 Fast leads

Grok 4.1 Fast: 72.7 (#133), Olmo 2 0325 32b Instruct: 61.5 (#244)

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
LMArena Instruction Following13761186
IFEval—78%

Long Context Grok 4.1 Fast leads

Grok 4.1 Fast: 42.4 (#126), Olmo 2 0325 32b Instruct: 36.2 (#234)

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
LMArena Longer Query13901194

Writing & Preference Grok 4.1 Fast leads

Grok 4.1 Fast: 57.2 (#131), Olmo 2 0325 32b Instruct: 42.1 (#236)

BenchmarkGrok 4.1 FastOlmo 2 0325 32b Instruct
LMArena Text14081218
LMArena Creative Writing13941199
LMArena Multi-Turn13891221
EQ-Bench Creative Writing1327—
WildBench—73.4%

Frequently asked questions

Is Grok 4.1 Fast better than Olmo 2 0325 32b Instruct?

Grok 4.1 Fast is the stronger model overall, scoring 41.4 to 32.7 on the Noometry Index.

Is Grok 4.1 Fast or Olmo 2 0325 32b Instruct better for coding?

Olmo 2 0325 32b Instruct scores higher on coding benchmarks: 35.2 versus 34.1 in the Noometry coding category.

How many benchmarks do Grok 4.1 Fast and Olmo 2 0325 32b Instruct share?

11 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Olmo 2 0325 32b Instruct has 16.

Related comparisons

Go deeper