Model comparison

Grok 4 Fast vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 39.4 on the Noometry Index.

Last verified . 21 shared benchmarks.

Grok 4 Fast xAI

39.4

Rank #167 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Grok 4 Fast scores higher in 1 category and Muse Spark 1.1 in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Muse Spark 1.1 leads 47.1 to 22.2.
  • The biggest single-benchmark swing is τ²-bench Banking: 15.7% for Grok 4 Fast and 40.5% for Muse Spark 1.1.

Side by side

Grok 4 Fast and Muse Spark 1.1 specifications
Grok 4 FastMuse Spark 1.1
ProviderxAIMeta
Noometry Index39.449.9
Released2025-09-192026-04-08
WeightsProprietaryProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked3037

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Grok 4 Fast: 32.5 (#271), Muse Spark 1.1: 51.3 (#40)

Coding benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
LMArena WebDev11591542
LMArena Coding14291498
DeepSWE—53.3%
SciCode—58.8%
WeirdML42.9%—

Agentic & Tool Use Muse Spark 1.1 leads

Grok 4 Fast: 29.5 (#86), Muse Spark 1.1: 30.8 (#73)

Agentic & Tool Use benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
τ²-bench Banking15.7%40.5%
APEX-Agents—31.8%
Cybench30%—
GBAEval—7.9%
GDP.pdf—15%
LMArena Search1171—
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Grok 4 Fast: 22.2 (#201), Muse Spark 1.1: 47.1 (#44)

Reasoning benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
LMArena Hard Prompts14121486
DTBench82.7%94.4%
Epoch Capabilities Index144.2154.21
ARC-AGI-25.3%—
Kagi LLM Benchmark66.1%—
NYT Connections (extended)—84.9%
ARC-AGI-148.5%—
CritPt—15.1%
LMCA—49.9%
Surface Evolver Bench—52.5%
ForecastBench60.5—

Math Muse Spark 1.1 leads

Grok 4 Fast: 38.9 (#123), Muse Spark 1.1: 45.5 (#76)

Math benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
LMArena Math14191483
ProofBench—39%

Knowledge Muse Spark 1.1 leads

Grok 4 Fast: 32.0 (#214), Muse Spark 1.1: 53.1 (#59)

Knowledge benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
LMArena Expert14111478
SimpleQA Verified—57.8%
Vectara Hallucination Rate19.7%—

Multimodal Not comparable

Grok 4 Fast: —, Muse Spark 1.1: 42.6 (#29)

Multimodal benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
LMArena Vision—1293
LMArena Document—1465

Multilingual Muse Spark 1.1 leads

Grok 4 Fast: 51.3 (#111), Muse Spark 1.1: 56.7 (#17)

Multilingual benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
LMArena Non-English13961472
LMArena Chinese14571518
LMArena French14311494
LMArena German13831466
LMArena Japanese13521451
LMArena Korean13571458
LMArena Russian13891483
LMArena Spanish14151464

Instruction Following Muse Spark 1.1 leads

Grok 4 Fast: 73.2 (#121), Muse Spark 1.1: 76.5 (#39)

Instruction Following benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
LMArena Instruction Following13871457

Long Context Grok 4 Fast leads

Grok 4 Fast: 63.2 (#3), Muse Spark 1.1: 44.8 (#58)

Long Context benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
LMArena Longer Query14151462
Fiction.LiveBench94.4%—

Writing & Preference Muse Spark 1.1 leads

Grok 4 Fast: 60.0 (#102), Muse Spark 1.1: 73.4 (#11)

Writing & Preference benchmarks
BenchmarkGrok 4 FastMuse Spark 1.1
LMArena Text14071479
LMArena Creative Writing13871437
LMArena Multi-Turn14141485
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260

Frequently asked questions

Is Grok 4 Fast better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 39.4 on the Noometry Index.

Is Grok 4 Fast or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 51.3 versus 32.5 in the Noometry coding category.

How many benchmarks do Grok 4 Fast and Muse Spark 1.1 share?

21 benchmarks have published results for both models. Grok 4 Fast has 30 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper