Model comparison

Llama 3-70B vs MiniMax-M2.1

MiniMax-M2.1 is the stronger model overall, scoring 38.4 to 28.5 on the Noometry Index.

Last verified . 17 shared benchmarks.

Llama 3-70B Meta

28.5

Rank #317 Confirmed

MiniMax-M2.1 MiniMax

38.4

Rank #177 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Llama 3-70B scores higher in 1 category and MiniMax-M2.1 in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where MiniMax-M2.1 leads 35.6 to 12.0.

Side by side

Llama 3-70B and MiniMax-M2.1 specifications
Llama 3-70BMiniMax-M2.1
ProviderMetaMiniMax
Noometry Index28.538.4
Released2024-04-182025-12-23
WeightsOpenOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked3122

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.1 leads

Llama 3-70B: 35.3 (#215), MiniMax-M2.1: 40.1 (#132)

Coding benchmarks
BenchmarkLlama 3-70BMiniMax-M2.1
LMArena Coding12061421
LMArena WebDev—1384
BigCodeBench Instruct43.6%—
BigCodeBench Complete54.5%—
ALE-Bench—623.83
HumanEval+72%—
MBPP+69%—

Agentic & Tool Use MiniMax-M2.1 leads

Llama 3-70B: 20.9 (#132), MiniMax-M2.1: 27.7 (#91)

Agentic & Tool Use benchmarks
BenchmarkLlama 3-70BMiniMax-M2.1
Terminal-Bench—36.6%
Cybench5%—

Reasoning Llama 3-70B leads

Llama 3-70B: 17.4 (#284), MiniMax-M2.1: 15.8 (#301)

Reasoning benchmarks
BenchmarkLlama 3-70BMiniMax-M2.1
LMArena Hard Prompts11951410
Kagi LLM Benchmark35.1%—
NYT Connections (extended)—11.2%
DTBench54.2%—
Epoch Capabilities Index122.91—
ForecastBench57.1—
WinoGrande83.5%—

Math MiniMax-M2.1 leads

Llama 3-70B: 12.0 (#299), MiniMax-M2.1: 35.6 (#142)

Math benchmarks
BenchmarkLlama 3-70BMiniMax-M2.1
LMArena Math12181396
OTIS Mock AIME 2024-20254.3%—
MATH Level 522.6%—

Knowledge MiniMax-M2.1 leads

Llama 3-70B: 20.8 (#272), MiniMax-M2.1: 37.7 (#143)

Knowledge benchmarks
BenchmarkLlama 3-70BMiniMax-M2.1
LMArena Expert11491432
GPQA Diamond40.6%—
Vectara Hallucination Rate—11.8%
MMLU79.3%—

Multilingual MiniMax-M2.1 leads

Llama 3-70B: 33.8 (#246), MiniMax-M2.1: 50.2 (#123)

Multilingual benchmarks
BenchmarkLlama 3-70BMiniMax-M2.1
LMArena Non-English11421378
LMArena Chinese11141430
LMArena French12311405
LMArena German11691380
LMArena Japanese10171287
LMArena Korean10171297
LMArena Russian11591386
LMArena Spanish12411396

Instruction Following MiniMax-M2.1 leads

Llama 3-70B: 62.8 (#233), MiniMax-M2.1: 74.0 (#108)

Instruction Following benchmarks
BenchmarkLlama 3-70BMiniMax-M2.1
LMArena Instruction Following11941399

Long Context MiniMax-M2.1 leads

Llama 3-70B: 35.6 (#235), MiniMax-M2.1: 43.2 (#98)

Long Context benchmarks
BenchmarkLlama 3-70BMiniMax-M2.1
LMArena Longer Query11741416

Writing & Preference MiniMax-M2.1 leads

Llama 3-70B: 43.0 (#225), MiniMax-M2.1: 58.5 (#114)

Writing & Preference benchmarks
BenchmarkLlama 3-70BMiniMax-M2.1
LMArena Text12211392
LMArena Creative Writing12101362
LMArena Multi-Turn12231396

Frequently asked questions

Is Llama 3-70B better than MiniMax-M2.1?

MiniMax-M2.1 is the stronger model overall, scoring 38.4 to 28.5 on the Noometry Index.

Is Llama 3-70B or MiniMax-M2.1 better for coding?

MiniMax-M2.1 scores higher on coding benchmarks: 40.1 versus 35.3 in the Noometry coding category.

How many benchmarks do Llama 3-70B and MiniMax-M2.1 share?

17 benchmarks have published results for both models. Llama 3-70B has 31 scored results on Noometry and MiniMax-M2.1 has 22.

Related comparisons

Go deeper