Model comparison

Mistral 7B vs Mistral Large 4

Mistral Large 4 is the stronger model overall, scoring 43.1 to 23.0 on the Noometry Index. Mistral 7B costs 4.1× less per token, which makes it the better buy when Mistral Large 4's lead doesn't matter for your workload.

Last verified . 12 shared benchmarks.

Mistral 7B Mistral AI

23.0

Rank #351 Confirmed

Mistral Large 4 Mistral AI

43.1

Rank #99 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Mistral 7B scores higher in 0 categories and Mistral Large 4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Mistral Large 4 leads 40.4 to 8.1.
  • Mistral 7B is cheaper at $0.25 / $0.25 per million input/output tokens, against $0.68 / $2.09 for Mistral Large 4.
  • Mistral Large 4 accepts more context: 1.05M tokens versus 8K.
  • Mistral 7B has downloadable open weights; the other is API-only.

Side by side

Mistral 7B and Mistral Large 4 specifications
Mistral 7BMistral Large 4
ProviderMistral AIMistral AI
Noometry Index23.043.1
Released2023-09-272026-10-06
WeightsOpenProprietary
Context window8K1.05M
Max output8K262K
Input $ / M tokens$0.25$0.68
Output $ / M tokens$0.25$2.09
Results tracked3715

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large 4 leads

Mistral 7B: 26.4 (#326), Mistral Large 4: 48.6 (#57)

Coding benchmarks
BenchmarkMistral 7BMistral Large 4
LMArena Coding10821475
LMArena WebDev—1541
BigCodeBench Instruct19.5%—
BigCodeBench Complete27.3%—
HumanEval+36%—
MBPP+42.1%—

Reasoning Mistral Large 4 leads

Mistral 7B: 13.1 (#336), Mistral Large 4: 22.5 (#192)

Reasoning benchmarks
BenchmarkMistral 7BMistral Large 4
LMArena Hard Prompts10671444
NYT Connections (extended)—27.4%
Chess Puzzles0%—
DTBench42.5%—
Adversarial NLI47.1%—
BIG-Bench Hard56.1%—
Epoch Capabilities Index112.21—
HellaSwag81%—
PIQA83%—
WinoGrande75.3%—

Math Mistral Large 4 leads

Mistral 7B: 8.1 (#325), Mistral Large 4: 40.4 (#91)

Math benchmarks
BenchmarkMistral 7BMistral Large 4
LMArena Math10851488
OTIS Mock AIME 2024-20250.3%—
MATH Level 53.7%—
GSM8K54.4%—

Knowledge Mistral Large 4 leads

Mistral 7B: 7.4 (#311), Mistral Large 4: 36.6 (#166)

Knowledge benchmarks
BenchmarkMistral 7BMistral Large 4
LMArena Expert10361447
GPQA Diamond15.2%—
SimpleQA Verified—20%
ARC (AI2) Challenge78.6%—
BoolQ87.4%—
MMLU62.5%—
OpenBookQA79.8%—
TriviaQA75.2%—

Multilingual Mistral Large 4 leads

Mistral 7B: 25.8 (#283), Mistral Large 4: 52.6 (#82)

Multilingual benchmarks
BenchmarkMistral 7BMistral Large 4
LMArena Non-English10121415
LMArena Chinese10091491
LMArena Russian10181414
LMArena French1037—
LMArena German987—
LMArena Japanese878—
LMArena Spanish1026—

Instruction Following Mistral Large 4 leads

Mistral 7B: 54.2 (#280), Mistral Large 4: 75.0 (#76)

Instruction Following benchmarks
BenchmarkMistral 7BMistral Large 4
LMArena Instruction Following10601424

Long Context Mistral Large 4 leads

Mistral 7B: 32.2 (#271), Mistral Large 4: 43.6 (#89)

Long Context benchmarks
BenchmarkMistral 7BMistral Large 4
LMArena Longer Query10601429

Writing & Preference Mistral Large 4 leads

Mistral 7B: 30.7 (#286), Mistral Large 4: 60.4 (#97)

Writing & Preference benchmarks
BenchmarkMistral 7BMistral Large 4
LMArena Text10901427
LMArena Creative Writing10681361
LMArena Multi-Turn10621424

Frequently asked questions

Is Mistral 7B better than Mistral Large 4?

Mistral Large 4 is the stronger model overall, scoring 43.1 to 23.0 on the Noometry Index. Mistral 7B costs 4.1× less per token, which makes it the better buy when Mistral Large 4's lead doesn't matter for your workload.

Which is cheaper, Mistral 7B or Mistral Large 4?

Mistral 7B is cheaper. It lists at $0.25 per million input tokens and $0.25 per million output tokens; Mistral Large 4 lists at $0.68 and $2.09.

Is Mistral 7B or Mistral Large 4 better for coding?

Mistral Large 4 scores higher on coding benchmarks: 48.6 versus 26.4 in the Noometry coding category.

Which has the bigger context window?

Mistral Large 4 does, with 1.05M tokens against 8K.

How many benchmarks do Mistral 7B and Mistral Large 4 share?

12 benchmarks have published results for both models. Mistral 7B has 37 scored results on Noometry and Mistral Large 4 has 15.

Related comparisons

Go deeper