Model comparison

Llama 2-70B vs MiniMax-M2.7

MiniMax-M2.7 is the stronger model overall, scoring 37.4 to 24.1 on the Noometry Index.

Last verified . 18 shared benchmarks.

Llama 2-70B Meta

24.1

Rank #343 Confirmed

MiniMax-M2.7 MiniMax

37.4

Rank #188 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Llama 2-70B scores higher in 0 categories and MiniMax-M2.7 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiniMax-M2.7 leads 37.1 to 7.4.

Side by side

Llama 2-70B and MiniMax-M2.7 specifications
Llama 2-70BMiniMax-M2.7
ProviderMetaMiniMax
Noometry Index24.137.4
Released2023-07-182026-03-18
WeightsOpenOpen
Context window—205K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked3530

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.7 leads

Llama 2-70B: 30.8 (#281), MiniMax-M2.7: 41.4 (#115)

Coding benchmarks
BenchmarkLlama 2-70BMiniMax-M2.7
LMArena Coding10791454
LMArena WebDev—1397
SciCode—47%
WeirdML—37%
ALE-Bench—599.25

Agentic & Tool Use Not comparable

Llama 2-70B: —, MiniMax-M2.7: 24.9 (#103)

Agentic & Tool Use benchmarks
BenchmarkLlama 2-70BMiniMax-M2.7
Terminal-Bench—45.1%
ExploitBench—13.3%
GBAEval—0%

Reasoning MiniMax-M2.7 leads

Llama 2-70B: 13.7 (#324), MiniMax-M2.7: 19.0 (#248)

Reasoning benchmarks
BenchmarkLlama 2-70BMiniMax-M2.7
LMArena Hard Prompts10731422
Epoch Capabilities Index113.59145.84
NYT Connections (extended)—24.7%
CritPt—0.6%
Thematic Generalization—39.3%
DTBench41.6%—
BIG-Bench Hard64.9%—
CommonsenseQA 2.050%—
ForecastBench51.4—
HellaSwag85.3%—
LAMBADA78.9%—
PIQA82.8%—
WinoGrande80.2%—

Math MiniMax-M2.7 leads

Llama 2-70B: 7.5 (#320), MiniMax-M2.7: 24.9 (#254)

Math benchmarks
BenchmarkLlama 2-70BMiniMax-M2.7
LMArena Math10911420
OTIS Mock AIME 2024-20250%—
ProofBench—3%
MATH Level 53.3%—
GSM8K69.6%—

Knowledge MiniMax-M2.7 leads

Llama 2-70B: 7.4 (#305), MiniMax-M2.7: 37.1 (#151)

Knowledge benchmarks
BenchmarkLlama 2-70BMiniMax-M2.7
LMArena Expert10391443
GPQA Diamond26.3%—
Vectara Hallucination Rate—12.9%
ARC (AI2) Challenge78.3%—
BoolQ88.6%—
MMLU69.9%—
OpenBookQA60.2%—
TriviaQA87.6%—

Multilingual MiniMax-M2.7 leads

Llama 2-70B: 27.9 (#269), MiniMax-M2.7: 50.5 (#120)

Multilingual benchmarks
BenchmarkLlama 2-70BMiniMax-M2.7
LMArena Non-English10451382
LMArena Chinese9941439
LMArena French10891422
LMArena German10411398
LMArena Japanese9271261
LMArena Korean9641313
LMArena Russian10831383
LMArena Spanish11421403

Instruction Following MiniMax-M2.7 leads

Llama 2-70B: 55.1 (#273), MiniMax-M2.7: 74.2 (#101)

Instruction Following benchmarks
BenchmarkLlama 2-70BMiniMax-M2.7
LMArena Instruction Following10711404

Long Context MiniMax-M2.7 leads

Llama 2-70B: 32.2 (#265), MiniMax-M2.7: 43.3 (#94)

Long Context benchmarks
BenchmarkLlama 2-70BMiniMax-M2.7
LMArena Longer Query10621419

Writing & Preference MiniMax-M2.7 leads

Llama 2-70B: 32.5 (#274), MiniMax-M2.7: 59.1 (#107)

Writing & Preference benchmarks
BenchmarkLlama 2-70BMiniMax-M2.7
LMArena Text11151404
LMArena Creative Writing10751354
LMArena Multi-Turn10881413

Frequently asked questions

Is Llama 2-70B better than MiniMax-M2.7?

MiniMax-M2.7 is the stronger model overall, scoring 37.4 to 24.1 on the Noometry Index.

Is Llama 2-70B or MiniMax-M2.7 better for coding?

MiniMax-M2.7 scores higher on coding benchmarks: 41.4 versus 30.8 in the Noometry coding category.

How many benchmarks do Llama 2-70B and MiniMax-M2.7 share?

18 benchmarks have published results for both models. Llama 2-70B has 35 scored results on Noometry and MiniMax-M2.7 has 30.

Related comparisons

Go deeper