Model comparison

MiniMax-M2.5 vs Mistral 7B

MiniMax-M2.5 is the stronger model overall, scoring 38.3 to 23.0 on the Noometry Index. Mistral 7B costs 2.1× less per token, which makes it the better buy when MiniMax-M2.5's lead doesn't matter for your workload.

Last verified . 17 shared benchmarks.

MiniMax-M2.5 MiniMax

38.3

Rank #188 Confirmed

Mistral 7B Mistral AI

23.0

Rank #351 Confirmed

Summary

  • They share 17 benchmarks with published results for both. MiniMax-M2.5 scores higher in 8 categories and Mistral 7B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where MiniMax-M2.5 leads 39.2 to 7.4.
  • Mistral 7B is cheaper at $0.25 / $0.25 per million input/output tokens, against $0.30 / $1.20 for MiniMax-M2.5.
  • MiniMax-M2.5 accepts more context: 205K tokens versus 8K.

Side by side

MiniMax-M2.5 and Mistral 7B specifications
MiniMax-M2.5Mistral 7B
ProviderMiniMaxMistral AI
Noometry Index38.323.0
Released2026-02-122023-09-27
WeightsOpenOpen
Context window205K8K
Max output131K8K
Input $ / M tokens$0.30$0.25
Output $ / M tokens$1.20$0.25
Results tracked3337

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.5 leads

MiniMax-M2.5: 48.1 (#58), Mistral 7B: 26.4 (#326)

Coding benchmarks
BenchmarkMiniMax-M2.5Mistral 7B
LMArena Coding13811082
SWE-bench Verified (bash only)75.8%—
LMArena WebDev1387—
SWE-bench Multilingual68.3%—
BigCodeBench Instruct—19.5%
BigCodeBench Complete—27.3%
ALE-Bench618.17—
HumanEval+—36%
MBPP+—42.1%

Agentic & Tool Use Not comparable

MiniMax-M2.5: 30.4 (#77), Mistral 7B: —

Agentic & Tool Use benchmarks
BenchmarkMiniMax-M2.5Mistral 7B
Terminal-Bench42.7%—
Vending-Bench 2-23.16—

Reasoning MiniMax-M2.5 leads

MiniMax-M2.5: 17.5 (#292), Mistral 7B: 13.1 (#336)

Reasoning benchmarks
BenchmarkMiniMax-M2.5Mistral 7B
LMArena Hard Prompts13721067
Epoch Capabilities Index146.68112.21
ARC-AGI-24.9%—
Kagi LLM Benchmark55.2%—
NYT Connections (extended)16.8%—
ARC-AGI-163.7%—
Chess Puzzles—0%
DTBench—42.5%
Adversarial NLI—47.1%
BIG-Bench Hard—56.1%
HellaSwag—81%
PIQA—83%
WinoGrande—75.3%

Math MiniMax-M2.5 leads

MiniMax-M2.5: 26.9 (#253), Mistral 7B: 8.1 (#325)

Math benchmarks
BenchmarkMiniMax-M2.5Mistral 7B
LMArena Math13781085
OTIS Mock AIME 2024-2025—0.3%
ProofBench4%—
MATH Level 5—3.7%
GSM8K—54.4%

Knowledge MiniMax-M2.5 leads

MiniMax-M2.5: 39.2 (#135), Mistral 7B: 7.4 (#311)

Knowledge benchmarks
BenchmarkMiniMax-M2.5Mistral 7B
LMArena Expert13791036
GPQA Diamond—15.2%
Vectara Hallucination Rate9.1%—
ARC (AI2) Challenge—78.6%
BoolQ—87.4%
MMLU—62.5%
OpenBookQA—79.8%
TriviaQA—75.2%

Multilingual MiniMax-M2.5 leads

MiniMax-M2.5: 47.1 (#152), Mistral 7B: 25.8 (#283)

Multilingual benchmarks
BenchmarkMiniMax-M2.5Mistral 7B
LMArena Non-English13381012
LMArena Chinese13931009
LMArena French13621037
LMArena German1362987
LMArena Japanese1171878
LMArena Russian13581018
LMArena Spanish13541026
LMArena Korean1232—

Instruction Following MiniMax-M2.5 leads

MiniMax-M2.5: 71.5 (#148), Mistral 7B: 54.2 (#280)

Instruction Following benchmarks
BenchmarkMiniMax-M2.5Mistral 7B
LMArena Instruction Following13531060

Long Context MiniMax-M2.5 leads

MiniMax-M2.5: 37.5 (#216), Mistral 7B: 32.2 (#271)

Long Context benchmarks
BenchmarkMiniMax-M2.5Mistral 7B
LMArena Longer Query13661060
CL-bench11.4%—
CL-bench Life6.3%—

Writing & Preference MiniMax-M2.5 leads

MiniMax-M2.5: 53.9 (#153), Mistral 7B: 30.7 (#286)

Writing & Preference benchmarks
BenchmarkMiniMax-M2.5Mistral 7B
LMArena Text13591090
LMArena Creative Writing13311068
LMArena Multi-Turn13641062
EQ-Bench Creative Writing1361—

Frequently asked questions

Is MiniMax-M2.5 better than Mistral 7B?

MiniMax-M2.5 is the stronger model overall, scoring 38.3 to 23.0 on the Noometry Index. Mistral 7B costs 2.1× less per token, which makes it the better buy when MiniMax-M2.5's lead doesn't matter for your workload.

Which is cheaper, MiniMax-M2.5 or Mistral 7B?

Mistral 7B is cheaper. It lists at $0.25 per million input tokens and $0.25 per million output tokens; MiniMax-M2.5 lists at $0.30 and $1.20.

Is MiniMax-M2.5 or Mistral 7B better for coding?

MiniMax-M2.5 scores higher on coding benchmarks: 48.1 versus 26.4 in the Noometry coding category.

Which has the bigger context window?

MiniMax-M2.5 does, with 205K tokens against 8K.

How many benchmarks do MiniMax-M2.5 and Mistral 7B share?

17 benchmarks have published results for both models. MiniMax-M2.5 has 33 scored results on Noometry and Mistral 7B has 37.

Related comparisons

Go deeper