Model comparison

GPT-4 vs MiniMax M1

MiniMax M1 is the stronger model overall, scoring 40.3 to 29.1 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-4 OpenAI

29.1

Rank #316 Confirmed

MiniMax M1 MiniMax

40.3

Rank #150 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GPT-4 scores higher in 0 categories and MiniMax M1 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where MiniMax M1 leads 37.5 to 10.8.
  • MiniMax M1 is cheaper at $0.55 / $2.20 per million input/output tokens, against $30 / $60 for GPT-4.
  • MiniMax M1 accepts more context: 1M tokens versus 8K.
  • MiniMax M1 has downloadable open weights; the other is API-only.

Side by side

GPT-4 and MiniMax M1 specifications
GPT-4MiniMax M1
ProviderOpenAIMiniMax
Noometry Index29.140.3
Released2023-03-142025-06-13
WeightsProprietaryOpen
Context window8K1M
Max output8K40K
Input $ / M tokens$30$0.55
Output $ / M tokens$60$2.20
Results tracked3818

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax M1 leads

GPT-4: 31.6 (#283), MiniMax M1: 39.9 (#153)

Coding benchmarks
BenchmarkGPT-4MiniMax M1
LMArena Coding12541359
WeirdML12.4%—
BigCodeBench Instruct46%—
BigCodeBench Complete57.2%—
HumanEval+79.3%—

Agentic & Tool Use Not comparable

GPT-4: —, MiniMax M1: —

Agentic & Tool Use benchmarks
BenchmarkGPT-4MiniMax M1
METR Time Horizons36.1%—

Reasoning MiniMax M1 leads

GPT-4: 17.8 (#289), MiniMax M1: 26.9 (#126)

Reasoning benchmarks
BenchmarkGPT-4MiniMax M1
LMArena Hard Prompts12411339
Chess Puzzles4%—
Mystery Game Puzzles12%—
DTBench62.7%—
LMCA17.1%—
BIG-Bench Hard75.1%—
Epoch Capabilities Index125.89—
ForecastBench57.8—
HellaSwag95.3%—
WinoGrande87.5%—

Math MiniMax M1 leads

GPT-4: 10.8 (#309), MiniMax M1: 37.5 (#151)

Math benchmarks
BenchmarkGPT-4MiniMax M1
LMArena Math12691361
OTIS Mock AIME 2024-20251.1%—
MATH Level 523%—
GSM8K92%—

Knowledge MiniMax M1 leads

GPT-4: 18.4 (#282), MiniMax M1: 36.4 (#170)

Knowledge benchmarks
BenchmarkGPT-4MiniMax M1
LMArena Expert12111317
GPQA Diamond35.7%—
MMLU86.4%—
TriviaQA84.8%—

Multilingual MiniMax M1 leads

GPT-4: 40.6 (#215), MiniMax M1: 45.8 (#163)

Multilingual benchmarks
BenchmarkGPT-4MiniMax M1
LMArena Non-English12461319
LMArena Chinese12421360
LMArena French12831370
LMArena German12511350
LMArena Japanese12091217
LMArena Korean11841266
LMArena Russian12511329
LMArena Spanish12611353

Instruction Following MiniMax M1 leads

GPT-4: 65.3 (#222), MiniMax M1: 69.3 (#174)

Instruction Following benchmarks
BenchmarkGPT-4MiniMax M1
LMArena Instruction Following12411312

Long Context MiniMax M1 leads

GPT-4: 37.7 (#212), MiniMax M1: 41.4 (#141)

Long Context benchmarks
BenchmarkGPT-4MiniMax M1
LMArena Longer Query12441326
Fiction.LiveBench—69.4%

Writing & Preference MiniMax M1 leads

GPT-4: 34.9 (#268), MiniMax M1: 53.1 (#161)

Writing & Preference benchmarks
BenchmarkGPT-4MiniMax M1
LMArena Text12631343
LMArena Creative Writing12441298
LMArena Multi-Turn12571335
EQ-Bench Creative Writing752—

Frequently asked questions

Is GPT-4 better than MiniMax M1?

MiniMax M1 is the stronger model overall, scoring 40.3 to 29.1 on the Noometry Index.

Which is cheaper, GPT-4 or MiniMax M1?

MiniMax M1 is cheaper. It lists at $0.55 per million input tokens and $2.20 per million output tokens; GPT-4 lists at $30 and $60.

Is GPT-4 or MiniMax M1 better for coding?

MiniMax M1 scores higher on coding benchmarks: 39.9 versus 31.6 in the Noometry coding category.

Which has the bigger context window?

MiniMax M1 does, with 1M tokens against 8K.

How many benchmarks do GPT-4 and MiniMax M1 share?

17 benchmarks have published results for both models. GPT-4 has 38 scored results on Noometry and MiniMax M1 has 18.

Related comparisons

Go deeper