Model comparison

Claude 2 vs MiniMax M1

MiniMax M1 is the stronger model overall, scoring 39.7 to 24.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2 Anthropic

24.7

Rank #342 Reported

MiniMax M1 MiniMax

39.7

Rank #146 Confirmed

Summary

  • The widest gap is in math, where MiniMax M1 leads 34.8 to 8.7.
  • MiniMax M1 has downloadable open weights; the other is API-only.

Side by side

Claude 2 and MiniMax M1 specifications
Claude 2MiniMax M1
ProviderAnthropicMiniMax
Noometry Index24.739.7
Released2023-07-112025-06-13
WeightsProprietaryOpen
Context window—1M
Max output—40K
Input $ / M tokens—$0.40
Output $ / M tokens—$2.20
Results tracked818

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, MiniMax M1: 39.2 (#149)

Coding benchmarks
BenchmarkClaude 2MiniMax M1
LMArena Coding—1359
HumanEval+61.6%—

Reasoning MiniMax M1 leads

Claude 2: 20.8 (#213), MiniMax M1: 25.8 (#125)

Reasoning benchmarks
BenchmarkClaude 2MiniMax M1
LMArena Hard Prompts—1340
DTBench51.9%—
Epoch Capabilities Index120.08—

Math MiniMax M1 leads

Claude 2: 8.7 (#314), MiniMax M1: 34.8 (#152)

Math benchmarks
BenchmarkClaude 2MiniMax M1
OTIS Mock AIME 2024-20252.5%—
LMArena Math—1360
MATH Level 511.7%—

Knowledge MiniMax M1 leads

Claude 2: 17.0 (#282), MiniMax M1: 35.7 (#168)

Knowledge benchmarks
BenchmarkClaude 2MiniMax M1
GPQA Diamond34.7%—
LMArena Expert—1316
MMLU78.5%—
TriviaQA87.5%—

Multilingual Not comparable

Claude 2: —, MiniMax M1: 46.0 (#157)

Multilingual benchmarks
BenchmarkClaude 2MiniMax M1
LMArena Non-English—1320
LMArena Chinese—1361
LMArena French—1369
LMArena German—1350
LMArena Japanese—1220
LMArena Korean—1263
LMArena Russian—1330
LMArena Spanish—1354

Instruction Following Not comparable

Claude 2: —, MiniMax M1: 69.5 (#169)

Instruction Following benchmarks
BenchmarkClaude 2MiniMax M1
LMArena Instruction Following—1312

Long Context Not comparable

Claude 2: —, MiniMax M1: 41.4 (#136)

Long Context benchmarks
BenchmarkClaude 2MiniMax M1
Fiction.LiveBench—69.4%
LMArena Longer Query—1326

Writing & Preference Not comparable

Claude 2: —, MiniMax M1: 53.3 (#155)

Writing & Preference benchmarks
BenchmarkClaude 2MiniMax M1
LMArena Text—1343
LMArena Creative Writing—1298
LMArena Multi-Turn—1335

Frequently asked questions

Is Claude 2 better than MiniMax M1?

MiniMax M1 is the stronger model overall, scoring 39.7 to 24.7 on the Noometry Index.

How many benchmarks do Claude 2 and MiniMax M1 share?

0 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and MiniMax M1 has 18.

Related comparisons

Go deeper