Model comparison

Claude 2 vs MiniMax-M2.7

MiniMax-M2.7 is the stronger model overall, scoring 37.4 to 24.7 on the Noometry Index.

Last verified . 1 shared benchmarks.

Claude 2 Anthropic

24.7

Rank #342 Reported

MiniMax-M2.7 MiniMax

37.4

Rank #188 Confirmed

Summary

  • They share 1 benchmark with published results for both. Claude 2 scores higher in 1 category and MiniMax-M2.7 in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiniMax-M2.7 leads 37.1 to 17.0.
  • MiniMax-M2.7 has downloadable open weights; the other is API-only.

Side by side

Claude 2 and MiniMax-M2.7 specifications
Claude 2MiniMax-M2.7
ProviderAnthropicMiniMax
Noometry Index24.737.4
Released2023-07-112026-03-18
WeightsProprietaryOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked830

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, MiniMax-M2.7: 41.4 (#115)

Coding benchmarks
BenchmarkClaude 2MiniMax-M2.7
LMArena WebDev—1397
SciCode—47%
WeirdML—37%
LMArena Coding—1454
ALE-Bench—599.25
HumanEval+61.6%—

Agentic & Tool Use Not comparable

Claude 2: —, MiniMax-M2.7: 24.9 (#103)

Agentic & Tool Use benchmarks
BenchmarkClaude 2MiniMax-M2.7
Terminal-Bench—45.1%
ExploitBench—13.3%
GBAEval—0%

Reasoning Claude 2 leads

Claude 2: 20.8 (#213), MiniMax-M2.7: 19.0 (#248)

Reasoning benchmarks
BenchmarkClaude 2MiniMax-M2.7
Epoch Capabilities Index120.08145.84
NYT Connections (extended)—24.7%
CritPt—0.6%
Thematic Generalization—39.3%
LMArena Hard Prompts—1422
DTBench51.9%—

Math MiniMax-M2.7 leads

Claude 2: 8.7 (#314), MiniMax-M2.7: 24.9 (#254)

Math benchmarks
BenchmarkClaude 2MiniMax-M2.7
OTIS Mock AIME 2024-20252.5%—
ProofBench—3%
LMArena Math—1420
MATH Level 511.7%—

Knowledge MiniMax-M2.7 leads

Claude 2: 17.0 (#282), MiniMax-M2.7: 37.1 (#151)

Knowledge benchmarks
BenchmarkClaude 2MiniMax-M2.7
GPQA Diamond34.7%—
Vectara Hallucination Rate—12.9%
LMArena Expert—1443
MMLU78.5%—
TriviaQA87.5%—

Multilingual Not comparable

Claude 2: —, MiniMax-M2.7: 50.5 (#120)

Multilingual benchmarks
BenchmarkClaude 2MiniMax-M2.7
LMArena Non-English—1382
LMArena Chinese—1439
LMArena French—1422
LMArena German—1398
LMArena Japanese—1261
LMArena Korean—1313
LMArena Russian—1383
LMArena Spanish—1403

Instruction Following Not comparable

Claude 2: —, MiniMax-M2.7: 74.2 (#101)

Instruction Following benchmarks
BenchmarkClaude 2MiniMax-M2.7
LMArena Instruction Following—1404

Long Context Not comparable

Claude 2: —, MiniMax-M2.7: 43.3 (#94)

Long Context benchmarks
BenchmarkClaude 2MiniMax-M2.7
LMArena Longer Query—1419

Writing & Preference Not comparable

Claude 2: —, MiniMax-M2.7: 59.1 (#107)

Writing & Preference benchmarks
BenchmarkClaude 2MiniMax-M2.7
LMArena Text—1404
LMArena Creative Writing—1354
LMArena Multi-Turn—1413

Frequently asked questions

Is Claude 2 better than MiniMax-M2.7?

MiniMax-M2.7 is the stronger model overall, scoring 37.4 to 24.7 on the Noometry Index.

How many benchmarks do Claude 2 and MiniMax-M2.7 share?

1 benchmark has published results for both models. Claude 2 has 8 scored results on Noometry and MiniMax-M2.7 has 30.

Related comparisons

Go deeper