Noometry

Model comparison

Claude 3 Sonnet vs MiniMax-M2.7

MiniMax-M2.7 is the stronger model overall, scoring 37.7 to 29.0 on the Noometry Index.

Last verified . 19 shared benchmarks.

Claude 3 Sonnet Anthropic

29.0

Rank #319 Confirmed

MiniMax-M2.7 MiniMax

37.7

Rank #196 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Claude 3 Sonnet scores higher in 1 category and MiniMax-M2.7 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where MiniMax-M2.7 leads 58.9 to 42.1.
  • The biggest single-benchmark swing is WeirdML: 10.2% for Claude 3 Sonnet and 37% for MiniMax-M2.7.
  • MiniMax-M2.7 has downloadable open weights; the other is API-only.

Side by side

Claude 3 SonnetMiniMax-M2.7
ProviderAnthropicMiniMax
Noometry Index29.037.7
Released2024-02-292026-03-18
WeightsProprietaryOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked3030

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.7 leads

Claude 3 Sonnet: 29.6 (#302), MiniMax-M2.7: 41.8 (#120)

BenchmarkClaude 3 SonnetMiniMax-M2.7
WeirdML10.2%37%
LMArena Coding12231454
LMArena WebDev—1398
SciCode—47%
BigCodeBench Instruct42.7%—
BigCodeBench Complete53.8%—
ALE-Bench—599.25
HumanEval+64%—
MBPP+69.3%—

Agentic & Tool Use Not comparable

Claude 3 Sonnet: —, MiniMax-M2.7: 25.1 (#111)

BenchmarkClaude 3 SonnetMiniMax-M2.7
Terminal-Bench—45.1%
ExploitBench—13.3%
GBAEval—0%

Reasoning Too close to call

Claude 3 Sonnet: 20.5 (#237), MiniMax-M2.7: 19.7 (#253)

BenchmarkClaude 3 SonnetMiniMax-M2.7
LMArena Hard Prompts11971422
Epoch Capabilities Index120.7145.85
NYT Connections (extended)—24.7%
CritPt—0.6%
Thematic Generalization—39.3%
DTBench53.6%—
WinoGrande75.1%—

Math MiniMax-M2.7 leads

Claude 3 Sonnet: 10.7 (#310), MiniMax-M2.7: 25.9 (#263)

BenchmarkClaude 3 SonnetMiniMax-M2.7
LMArena Math12131420
OTIS Mock AIME 2024-20252.5%—
ProofBench—3%
MATH Level 518.2%—

Knowledge MiniMax-M2.7 leads

Claude 3 Sonnet: 21.1 (#276), MiniMax-M2.7: 37.7 (#152)

BenchmarkClaude 3 SonnetMiniMax-M2.7
LMArena Expert11731444
GPQA Diamond40.6%—
Vectara Hallucination Rate—12.9%
MMLU75.9%—

Multimodal Not comparable

Claude 3 Sonnet: 25.2 (#125), MiniMax-M2.7: —

BenchmarkClaude 3 SonnetMiniMax-M2.7
LMArena Vision984—

Multilingual MiniMax-M2.7 leads

Claude 3 Sonnet: 37.8 (#234), MiniMax-M2.7: 50.3 (#123)

BenchmarkClaude 3 SonnetMiniMax-M2.7
LMArena Non-English12051382
LMArena Chinese11891441
LMArena French12291421
LMArena German12041398
LMArena Japanese11311262
LMArena Korean11281313
LMArena Russian12271383
LMArena Spanish12041403

Instruction Following MiniMax-M2.7 leads

Claude 3 Sonnet: 62.8 (#235), MiniMax-M2.7: 74.1 (#103)

BenchmarkClaude 3 SonnetMiniMax-M2.7
LMArena Instruction Following11991405

Long Context MiniMax-M2.7 leads

Claude 3 Sonnet: 36.7 (#228), MiniMax-M2.7: 43.3 (#99)

BenchmarkClaude 3 SonnetMiniMax-M2.7
LMArena Longer Query12111419

Writing & Preference MiniMax-M2.7 leads

Claude 3 Sonnet: 42.1 (#238), MiniMax-M2.7: 58.9 (#112)

BenchmarkClaude 3 SonnetMiniMax-M2.7
LMArena Text12181405
LMArena Creative Writing11861354
LMArena Multi-Turn12271412

Frequently asked questions

Is Claude 3 Sonnet better than MiniMax-M2.7?

MiniMax-M2.7 is the stronger model overall, scoring 37.7 to 29.0 on the Noometry Index.

Is Claude 3 Sonnet or MiniMax-M2.7 better for coding?

MiniMax-M2.7 scores higher on coding benchmarks: 41.8 versus 29.6 in the Noometry coding category.

How many benchmarks do Claude 3 Sonnet and MiniMax-M2.7 share?

19 benchmarks have published results for both models. Claude 3 Sonnet has 30 scored results on Noometry and MiniMax-M2.7 has 30.

Related comparisons

Go deeper