Noometry

Model comparison

Claude 3.5 Haiku vs MiniMax M1

MiniMax M1 is the stronger model overall, scoring 39.7 to 28.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Claude 3.5 Haiku Anthropic

28.9

Rank #309 Confirmed

MiniMax M1 MiniMax

39.7

Rank #146 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Claude 3.5 Haiku scores higher in 0 categories and MiniMax M1 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where MiniMax M1 leads 34.8 to 13.7.
  • MiniMax M1 has downloadable open weights; the other is API-only.

Side by side

Claude 3.5 HaikuMiniMax M1
ProviderAnthropicMiniMax
Noometry Index28.939.7
Released2024-10-222025-06-13
WeightsProprietaryOpen
Context window—1M
Max output—40K
Input $ / M tokens—$0.40
Output $ / M tokens—$2.20
Results tracked4918

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax M1 leads

Claude 3.5 Haiku: 32.6 (#258), MiniMax M1: 39.2 (#149)

BenchmarkClaude 3.5 HaikuMiniMax M1
LMArena Coding12871359
Aider Polyglot28%—
SciCode27.4%—
WeirdML30.7%—
BigCodeBench Instruct46.1%—
LiveBench Coding51.4%—
BigCodeBench Complete59%—
CadEval32%—

Agentic & Tool Use Not comparable

Claude 3.5 Haiku: 27.7 (#90), MiniMax M1: —

BenchmarkClaude 3.5 HaikuMiniMax M1
BALROG19.3%—

Reasoning MiniMax M1 leads

Claude 3.5 Haiku: 17.1 (#286), MiniMax M1: 25.8 (#125)

BenchmarkClaude 3.5 HaikuMiniMax M1
LMArena Hard Prompts12511340
CritPt0%—
LiveBench Reasoning28.1%—
DTBench56.7%—
LiveBench Data Analysis48.5%—
Epoch Capabilities Index127.15—
LiveBench43.5%—

Math MiniMax M1 leads

Claude 3.5 Haiku: 13.7 (#294), MiniMax M1: 34.8 (#152)

BenchmarkClaude 3.5 HaikuMiniMax M1
LMArena Math12441360
OTIS Mock AIME 2024-20254.3%—
Omni-MATH22.4%—
LiveBench Math35.5%—
MATH Level 546.4%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge MiniMax M1 leads

Claude 3.5 Haiku: 18.7 (#276), MiniMax M1: 35.7 (#168)

BenchmarkClaude 3.5 HaikuMiniMax M1
LMArena Expert12081316
GPQA Diamond38.1%—
MMLU-Pro60.5%—
Confabulations36.7%—
GPQA (HELM)36.3%—
MMLU74.3%—

Multimodal Not comparable

Claude 3.5 Haiku: 26.3 (#113), MiniMax M1: —

BenchmarkClaude 3.5 HaikuMiniMax M1
LMArena Vision1092—
GeoBench34%—

Multilingual MiniMax M1 leads

Claude 3.5 Haiku: 40.2 (#213), MiniMax M1: 46.0 (#157)

BenchmarkClaude 3.5 HaikuMiniMax M1
LMArena Non-English12381320
LMArena Chinese12291361
LMArena French12621369
LMArena German12371350
LMArena Japanese11751220
LMArena Korean11721263
LMArena Russian12531330
LMArena Spanish12611354

Instruction Following MiniMax M1 leads

Claude 3.5 Haiku: 63.1 (#229), MiniMax M1: 69.5 (#169)

BenchmarkClaude 3.5 HaikuMiniMax M1
LMArena Instruction Following12411312
LiveBench Instruction Following61.9%—
IFEval79.2%—

Long Context MiniMax M1 leads

Claude 3.5 Haiku: 38.3 (#195), MiniMax M1: 41.4 (#136)

BenchmarkClaude 3.5 HaikuMiniMax M1
LMArena Longer Query12611326
Fiction.LiveBench—69.4%

Writing & Preference MiniMax M1 leads

Claude 3.5 Haiku: 42.9 (#228), MiniMax M1: 53.3 (#155)

BenchmarkClaude 3.5 HaikuMiniMax M1
LMArena Text12551343
LMArena Creative Writing12331298
LMArena Multi-Turn12651335
Short-Story Creative Writing73.5%—
EQ-Bench Creative Writing1146—
WildBench76%—
LiveBench Language35.4%—

Frequently asked questions

Is Claude 3.5 Haiku better than MiniMax M1?

MiniMax M1 is the stronger model overall, scoring 39.7 to 28.9 on the Noometry Index.

Is Claude 3.5 Haiku or MiniMax M1 better for coding?

MiniMax M1 scores higher on coding benchmarks: 39.2 versus 32.6 in the Noometry coding category.

How many benchmarks do Claude 3.5 Haiku and MiniMax M1 share?

17 benchmarks have published results for both models. Claude 3.5 Haiku has 49 scored results on Noometry and MiniMax M1 has 18.

Related comparisons

Go deeper