Model comparison

Llama-3.3-70B-Instruct vs MiniMax-M2.5

MiniMax-M2.5 is the stronger model overall, scoring 38.1 to 30.3 on the Noometry Index. Llama-3.3-70B-Instruct costs 3.4× less per token, which makes it the better buy when MiniMax-M2.5's lead doesn't matter for your workload.

Last verified . 19 shared benchmarks.

Llama-3.3-70B-Instruct Meta

30.3

Rank #283 Confirmed

MiniMax-M2.5 MiniMax

38.1

Rank #181 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Llama-3.3-70B-Instruct scores higher in 0 categories and MiniMax-M2.5 in 9 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where MiniMax-M2.5 leads 47.9 to 30.6.
  • The biggest single-benchmark swing is Vectara Hallucination Rate: 4.1% for Llama-3.3-70B-Instruct and 9.1% for MiniMax-M2.5.
  • Llama-3.3-70B-Instruct is cheaper at $0.10 / $0.32 per million input/output tokens, against $0.30 / $1.20 for MiniMax-M2.5.
  • MiniMax-M2.5 accepts more context: 205K tokens versus 128K.

Side by side

Llama-3.3-70B-Instruct and MiniMax-M2.5 specifications
Llama-3.3-70B-InstructMiniMax-M2.5
ProviderMetaMiniMax
Noometry Index30.338.1
Released2024-12-062026-02-12
WeightsOpenOpen
Context window128K205K
Max output4K131K
Input $ / M tokens$0.10$0.30
Output $ / M tokens$0.32$1.20
Results tracked4333

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.5 leads

Llama-3.3-70B-Instruct: 30.6 (#284), MiniMax-M2.5: 47.9 (#53)

Coding benchmarks
BenchmarkLlama-3.3-70B-InstructMiniMax-M2.5
LMArena Coding12681380
SWE-bench Verified (bash only)—75.8%
LMArena WebDev—1386
SWE-bench Multilingual—68.3%
SciCode26%—
WeirdML14.4%—
BigCodeBench Instruct46.9%—
LiveBench Coding36.6%—
BigCodeBench Complete57.5%—
ALE-Bench—618.17

Agentic & Tool Use MiniMax-M2.5 leads

Llama-3.3-70B-Instruct: 25.6 (#100), MiniMax-M2.5: 30.2 (#70)

Agentic & Tool Use benchmarks
BenchmarkLlama-3.3-70B-InstructMiniMax-M2.5
Terminal-Bench—42.7%
Berkeley Function Calling Leaderboard31.9%—
BALROG23%—
Vending-Bench 2—-23.16

Reasoning MiniMax-M2.5 leads

Llama-3.3-70B-Instruct: 13.7 (#325), MiniMax-M2.5: 17.6 (#281)

Reasoning benchmarks
BenchmarkLlama-3.3-70B-InstructMiniMax-M2.5
LMArena Hard Prompts12571372
Epoch Capabilities Index127.32146.68
ARC-AGI-2—4.9%
SimpleBench19.9%—
Kagi LLM Benchmark—55.2%
NYT Connections (extended)—16.8%
ARC-AGI-1—63.7%
CritPt0%—
LiveBench Reasoning50.8%—
DTBench59.5%—
LiveBench Data Analysis49.5%—
LMCA17.5%—
ForecastBench58.6—
LiveBench50.2%—

Math MiniMax-M2.5 leads

Llama-3.3-70B-Instruct: 14.3 (#292), MiniMax-M2.5: 25.8 (#242)

Math benchmarks
BenchmarkLlama-3.3-70B-InstructMiniMax-M2.5
LMArena Math12681378
OTIS Mock AIME 2024-20255.1%—
ProofBench—4%
LiveBench Math42.2%—
MATH Level 541.6%—

Knowledge MiniMax-M2.5 leads

Llama-3.3-70B-Instruct: 30.5 (#220), MiniMax-M2.5: 38.6 (#132)

Knowledge benchmarks
BenchmarkLlama-3.3-70B-InstructMiniMax-M2.5
Vectara Hallucination Rate4.1%9.1%
LMArena Expert12251378
GPQA Diamond47.4%—
Confabulations22.8%—
MMLU86.3%—

Multilingual MiniMax-M2.5 leads

Llama-3.3-70B-Instruct: 40.1 (#215), MiniMax-M2.5: 47.3 (#147)

Multilingual benchmarks
BenchmarkLlama-3.3-70B-InstructMiniMax-M2.5
LMArena Non-English12361338
LMArena Chinese12171392
LMArena French12801363
LMArena German12511361
LMArena Japanese11491169
LMArena Korean11421232
LMArena Russian12521359
LMArena Spanish12691354

Instruction Following Too close to call

Llama-3.3-70B-Instruct: 71.3 (#152), MiniMax-M2.5: 71.7 (#143)

Instruction Following benchmarks
BenchmarkLlama-3.3-70B-InstructMiniMax-M2.5
LMArena Instruction Following12421353
LiveBench Instruction Following82.7%—

Long Context MiniMax-M2.5 leads

Llama-3.3-70B-Instruct: 26.4 (#290), MiniMax-M2.5: 37.4 (#211)

Long Context benchmarks
BenchmarkLlama-3.3-70B-InstructMiniMax-M2.5
LMArena Longer Query12561367
Fiction.LiveBench33.3%—
CL-bench—11.4%
CL-bench Life—6.3%

Writing & Preference MiniMax-M2.5 leads

Llama-3.3-70B-Instruct: 47.8 (#203), MiniMax-M2.5: 54.1 (#149)

Writing & Preference benchmarks
BenchmarkLlama-3.3-70B-InstructMiniMax-M2.5
LMArena Text12741359
LMArena Creative Writing12501331
LMArena Multi-Turn12791364
EQ-Bench Creative Writing—1361
LiveBench Language39.2%—

Frequently asked questions

Is Llama-3.3-70B-Instruct better than MiniMax-M2.5?

MiniMax-M2.5 is the stronger model overall, scoring 38.1 to 30.3 on the Noometry Index. Llama-3.3-70B-Instruct costs 3.4× less per token, which makes it the better buy when MiniMax-M2.5's lead doesn't matter for your workload.

Which is cheaper, Llama-3.3-70B-Instruct or MiniMax-M2.5?

Llama-3.3-70B-Instruct is cheaper. It lists at $0.10 per million input tokens and $0.32 per million output tokens; MiniMax-M2.5 lists at $0.30 and $1.20.

Is Llama-3.3-70B-Instruct or MiniMax-M2.5 better for coding?

MiniMax-M2.5 scores higher on coding benchmarks: 47.9 versus 30.6 in the Noometry coding category.

Which has the bigger context window?

MiniMax-M2.5 does, with 205K tokens against 128K.

How many benchmarks do Llama-3.3-70B-Instruct and MiniMax-M2.5 share?

19 benchmarks have published results for both models. Llama-3.3-70B-Instruct has 43 scored results on Noometry and MiniMax-M2.5 has 33.

Related comparisons

Go deeper