Model comparison

Grok 4.20 (Non-Reasoning) vs MiniMax-M2.5

Grok 4.20 (Non-Reasoning) is the stronger model overall, scoring 48.6 to 38.3 on the Noometry Index. MiniMax-M2.5 costs 3.0× less per token, which makes it the better buy when Grok 4.20 (Non-Reasoning)'s lead doesn't matter for your workload.

Last verified . 30 shared benchmarks.

Grok 4.20 (Non-Reasoning) xAI

48.6

Rank #54 Confirmed

MiniMax-M2.5 MiniMax

38.3

Rank #188 Confirmed

Summary

  • They share 30 benchmarks with published results for both. Grok 4.20 (Non-Reasoning) scores higher in 8 categories and MiniMax-M2.5 in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.20 (Non-Reasoning) leads 52.3 to 17.5.
  • The biggest single-benchmark swing is NYT Connections (extended): 85.4% for Grok 4.20 (Non-Reasoning) and 16.8% for MiniMax-M2.5.
  • MiniMax-M2.5 is cheaper at $0.30 / $1.20 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 (Non-Reasoning).
  • Grok 4.20 (Non-Reasoning) accepts more context: 1M tokens versus 205K.
  • MiniMax-M2.5 has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 (Non-Reasoning) and MiniMax-M2.5 specifications
Grok 4.20 (Non-Reasoning)MiniMax-M2.5
ProviderxAIMiniMax
Noometry Index48.638.3
Released2026-02-172026-02-12
WeightsProprietaryOpen
Context window1M205K
Max output30K131K
Input $ / M tokens$1.25$0.30
Output $ / M tokens$2.50$1.20
Results tracked4633

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.5 leads

Grok 4.20 (Non-Reasoning): 42.1 (#112), MiniMax-M2.5: 48.1 (#58)

Coding benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
LMArena WebDev13751387
LMArena Coding14591381
ALE-Bench1,150618.17
SWE-bench Verified (bash only)—75.8%
SWE-bench Multilingual—68.3%
WeirdML52.3%—

Agentic & Tool Use Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 34.4 (#46), MiniMax-M2.5: 30.4 (#77)

Agentic & Tool Use benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
Terminal-Bench57.3%42.7%
Vending-Bench 24,663-23.16
τ²-bench Banking18%—
LMArena Search1189—

Reasoning Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 52.3 (#32), MiniMax-M2.5: 17.5 (#292)

Reasoning benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
ARC-AGI-265.1%4.9%
Kagi LLM Benchmark75%55.2%
NYT Connections (extended)85.4%16.8%
ARC-AGI-189.5%63.7%
LMArena Hard Prompts14511372
Epoch Capabilities Index151.98146.68
Chess Puzzles24%—
Thematic Generalization63.8%—
DTBench90.1%—
LMCA38.7%—
ForecastBench61.4—

Math Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 48.2 (#65), MiniMax-M2.5: 26.9 (#253)

Math benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
ProofBench14%4%
LMArena Math14551378
FrontierMath (Tiers 1-3)44.9%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202592.2%—

Knowledge Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 52.8 (#60), MiniMax-M2.5: 39.2 (#135)

Knowledge benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
LMArena Expert14391379
GPQA Diamond89.3%—
SimpleQA Verified30.2%—
Vectara Hallucination Rate—9.1%

Multimodal Not comparable

Grok 4.20 (Non-Reasoning): 33.3 (#98), MiniMax-M2.5: —

Multimodal benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
LMArena Vision1263—
Blueprint-Bench 20%—
LMArena Document1416—

Multilingual Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 54.5 (#40), MiniMax-M2.5: 47.1 (#152)

Multilingual benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
LMArena Non-English14411338
LMArena Chinese14811393
LMArena French14761362
LMArena German14651362
LMArena Japanese14491171
LMArena Korean14171232
LMArena Russian14581358
LMArena Spanish14431354

Instruction Following Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 74.8 (#83), MiniMax-M2.5: 71.5 (#148)

Instruction Following benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
LMArena Instruction Following14201353

Long Context Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 45.5 (#34), MiniMax-M2.5: 37.5 (#216)

Long Context benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
CL-bench22.2%11.4%
CL-bench Life11.9%6.3%
LMArena Longer Query14371366

Writing & Preference Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 65.7 (#44), MiniMax-M2.5: 53.9 (#153)

Writing & Preference benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)MiniMax-M2.5
LMArena Text14511359
LMArena Creative Writing14381331
EQ-Bench Creative Writing15741361
LMArena Multi-Turn14561364

Frequently asked questions

Is Grok 4.20 (Non-Reasoning) better than MiniMax-M2.5?

Grok 4.20 (Non-Reasoning) is the stronger model overall, scoring 48.6 to 38.3 on the Noometry Index. MiniMax-M2.5 costs 3.0× less per token, which makes it the better buy when Grok 4.20 (Non-Reasoning)'s lead doesn't matter for your workload.

Which is cheaper, Grok 4.20 (Non-Reasoning) or MiniMax-M2.5?

MiniMax-M2.5 is cheaper. It lists at $0.30 per million input tokens and $1.20 per million output tokens; Grok 4.20 (Non-Reasoning) lists at $1.25 and $2.50.

Is Grok 4.20 (Non-Reasoning) or MiniMax-M2.5 better for coding?

MiniMax-M2.5 scores higher on coding benchmarks: 48.1 versus 42.1 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 (Non-Reasoning) does, with 1M tokens against 205K.

How many benchmarks do Grok 4.20 (Non-Reasoning) and MiniMax-M2.5 share?

30 benchmarks have published results for both models. Grok 4.20 (Non-Reasoning) has 46 scored results on Noometry and MiniMax-M2.5 has 33.

Related comparisons

Go deeper