Noometry

Model comparison

Grok-2 (Dec 2024) vs MiniMax-M3

MiniMax-M3 is the stronger model overall, scoring 43.8 to 33.7 on the Noometry Index.

Last verified . 22 shared benchmarks.

Grok-2 (Dec 2024) xAI

33.7

Rank #239 Confirmed

MiniMax-M3 MiniMax

43.8

Rank #85 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Grok-2 (Dec 2024) scores higher in 0 categories and MiniMax-M3 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiniMax-M3 leads 58.4 to 29.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 11.5% for Grok-2 (Dec 2024) and 71.1% for MiniMax-M3.
  • MiniMax-M3 has downloadable open weights; the other is API-only.

Side by side

Grok-2 (Dec 2024)MiniMax-M3
ProviderxAIMiniMax
Noometry Index33.743.8
Released2024-08-132026-06-01
WeightsProprietaryOpen
Context window—1M
Max output—512K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked3441

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M3 leads

Grok-2 (Dec 2024): 33.3 (#258), MiniMax-M3: 41.8 (#118)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
LMArena Coding12871469
FrontierCode—14.7%
LMArena WebDev—1482
SciCode—47.1%
WeirdML22.2%—
LiveBench Coding46.4%—
ALE-Bench—640.02

Agentic & Tool Use Not comparable

Grok-2 (Dec 2024): —, MiniMax-M3: 22.6 (#130)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
APEX-Agents—37.7%
OSWorld 2.0—4.6%
GBAEval—0.9%
Vending-Bench 2—2,158

Reasoning MiniMax-M3 leads

Grok-2 (Dec 2024): 16.9 (#299), MiniMax-M3: 30.1 (#87)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
SimpleBench22.7%45.8%
LMArena Hard Prompts12721447
DTBench65.2%78.9%
Epoch Capabilities Index130.48146.95
NYT Connections (extended)—65.1%
CritPt—3.7%
Chess Puzzles—14%
LiveBench Reasoning54.8%—
Mystery Game Puzzles—8%
LiveBench Data Analysis54.5%—
LMCA—33.7%
Surface Evolver Bench—55%
ForecastBench—61.4
LiveBench54.3%—

Math MiniMax-M3 leads

Grok-2 (Dec 2024): 20.8 (#284), MiniMax-M3: 40.0 (#95)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
OTIS Mock AIME 2024-202511.5%71.1%
LMArena Math12831429
ProofBench—18%
LiveBench Math54.9%—
MATH Level 563.5%—
FrontierMath (Feb 2025 set)0.7%—

Knowledge MiniMax-M3 leads

Grok-2 (Dec 2024): 29.8 (#233), MiniMax-M3: 58.4 (#35)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
GPQA Diamond53.8%90.9%
LMArena Expert12541461
Confabulations20.1%—

Multimodal Not comparable

Grok-2 (Dec 2024): —, MiniMax-M3: 40.2 (#51)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
LMArena Vision—1253
LMArena Document—1435

Multilingual MiniMax-M3 leads

Grok-2 (Dec 2024): 43.1 (#188), MiniMax-M3: 53.0 (#75)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
LMArena Non-English12821420
LMArena Chinese12891463
LMArena French13181447
LMArena German12871426
LMArena Japanese12441381
LMArena Korean12371372
LMArena Russian12861428
LMArena Spanish12811432

Instruction Following MiniMax-M3 leads

Grok-2 (Dec 2024): 66.9 (#202), MiniMax-M3: 75.5 (#62)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
LMArena Instruction Following12701433
LiveBench Instruction Following69.6%—

Long Context MiniMax-M3 leads

Grok-2 (Dec 2024): 38.8 (#190), MiniMax-M3: 44.2 (#72)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
LMArena Longer Query12761445

Writing & Preference MiniMax-M3 leads

Grok-2 (Dec 2024): 48.6 (#198), MiniMax-M3: 62.1 (#83)

BenchmarkGrok-2 (Dec 2024)MiniMax-M3
LMArena Text13051433
LMArena Creative Writing12841404
LMArena Multi-Turn12901442
Short-Story Creative Writing63.6%—
EQ-Bench 4—1150
LiveBench Language45.6%—

Frequently asked questions

Is Grok-2 (Dec 2024) better than MiniMax-M3?

MiniMax-M3 is the stronger model overall, scoring 43.8 to 33.7 on the Noometry Index.

Is Grok-2 (Dec 2024) or MiniMax-M3 better for coding?

MiniMax-M3 scores higher on coding benchmarks: 41.8 versus 33.3 in the Noometry coding category.

How many benchmarks do Grok-2 (Dec 2024) and MiniMax-M3 share?

22 benchmarks have published results for both models. Grok-2 (Dec 2024) has 34 scored results on Noometry and MiniMax-M3 has 41.

Related comparisons

Go deeper