Noometry

Model comparison

Grok-2 (Dec 2024) vs MiniMax-M2.7

MiniMax-M2.7 is the stronger model overall, scoring 37.4 to 33.4 on the Noometry Index.

Last verified . 19 shared benchmarks.

Grok-2 (Dec 2024) xAI

33.4

Rank #233 Confirmed

MiniMax-M2.7 MiniMax

37.4

Rank #188 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Grok-2 (Dec 2024) scores higher in 0 categories and MiniMax-M2.7 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiniMax-M2.7 leads 59.1 to 48.8.
  • The biggest single-benchmark swing is WeirdML: 22.2% for Grok-2 (Dec 2024) and 37% for MiniMax-M2.7.
  • MiniMax-M2.7 has downloadable open weights; the other is API-only.

Side by side

Grok-2 (Dec 2024)MiniMax-M2.7
ProviderxAIMiniMax
Noometry Index33.437.4
Released2024-08-132026-03-18
WeightsProprietaryOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked3430

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.7 leads

Grok-2 (Dec 2024): 32.9 (#254), MiniMax-M2.7: 41.4 (#115)

BenchmarkGrok-2 (Dec 2024)MiniMax-M2.7
WeirdML22.2%37%
LMArena Coding12881454
LMArena WebDev—1397
SciCode—47%
LiveBench Coding46.4%—
ALE-Bench—599.25

Agentic & Tool Use Not comparable

Grok-2 (Dec 2024): —, MiniMax-M2.7: 24.9 (#103)

BenchmarkGrok-2 (Dec 2024)MiniMax-M2.7
Terminal-Bench—45.1%
ExploitBench—13.3%
GBAEval—0%

Reasoning MiniMax-M2.7 leads

Grok-2 (Dec 2024): 16.4 (#294), MiniMax-M2.7: 19.0 (#248)

BenchmarkGrok-2 (Dec 2024)MiniMax-M2.7
LMArena Hard Prompts12721422
Epoch Capabilities Index130.48145.84
SimpleBench22.7%—
NYT Connections (extended)—24.7%
CritPt—0.6%
Thematic Generalization—39.3%
LiveBench Reasoning54.8%—
DTBench65.2%—
LiveBench Data Analysis54.5%—
LiveBench54.3%—

Math MiniMax-M2.7 leads

Grok-2 (Dec 2024): 19.6 (#278), MiniMax-M2.7: 24.9 (#254)

BenchmarkGrok-2 (Dec 2024)MiniMax-M2.7
LMArena Math12831420
OTIS Mock AIME 2024-202511.5%—
ProofBench—3%
LiveBench Math54.9%—
MATH Level 563.5%—
FrontierMath (Feb 2025 set)0.7%—

Knowledge MiniMax-M2.7 leads

Grok-2 (Dec 2024): 29.8 (#225), MiniMax-M2.7: 37.1 (#151)

BenchmarkGrok-2 (Dec 2024)MiniMax-M2.7
LMArena Expert12541443
GPQA Diamond53.8%—
Confabulations20.1%—
Vectara Hallucination Rate—12.9%

Multilingual MiniMax-M2.7 leads

Grok-2 (Dec 2024): 43.3 (#183), MiniMax-M2.7: 50.5 (#120)

BenchmarkGrok-2 (Dec 2024)MiniMax-M2.7
LMArena Non-English12821382
LMArena Chinese12891439
LMArena French13171422
LMArena German12871398
LMArena Japanese12441261
LMArena Korean12371313
LMArena Russian12861383
LMArena Spanish12811403

Instruction Following MiniMax-M2.7 leads

Grok-2 (Dec 2024): 67.1 (#197), MiniMax-M2.7: 74.2 (#101)

BenchmarkGrok-2 (Dec 2024)MiniMax-M2.7
LMArena Instruction Following12701404
LiveBench Instruction Following69.6%—

Long Context MiniMax-M2.7 leads

Grok-2 (Dec 2024): 38.7 (#186), MiniMax-M2.7: 43.3 (#94)

BenchmarkGrok-2 (Dec 2024)MiniMax-M2.7
LMArena Longer Query12761419

Writing & Preference MiniMax-M2.7 leads

Grok-2 (Dec 2024): 48.8 (#192), MiniMax-M2.7: 59.1 (#107)

BenchmarkGrok-2 (Dec 2024)MiniMax-M2.7
LMArena Text13051404
LMArena Creative Writing12841354
LMArena Multi-Turn12901413
Short-Story Creative Writing63.6%—
LiveBench Language45.6%—

Frequently asked questions

Is Grok-2 (Dec 2024) better than MiniMax-M2.7?

MiniMax-M2.7 is the stronger model overall, scoring 37.4 to 33.4 on the Noometry Index.

Is Grok-2 (Dec 2024) or MiniMax-M2.7 better for coding?

MiniMax-M2.7 scores higher on coding benchmarks: 41.4 versus 32.9 in the Noometry coding category.

How many benchmarks do Grok-2 (Dec 2024) and MiniMax-M2.7 share?

19 benchmarks have published results for both models. Grok-2 (Dec 2024) has 34 scored results on Noometry and MiniMax-M2.7 has 30.

Related comparisons

Go deeper