Model comparison

Mistral 7B vs Mistral Large 3

Mistral Large 3 is the stronger model overall, scoring 39.1 to 23.0 on the Noometry Index. Mistral 7B costs 1.5× less per token, which makes it the better buy when Mistral Large 3's lead doesn't matter for your workload.

Last verified . 16 shared benchmarks.

Mistral 7B Mistral AI

23.0

Rank #351 Confirmed

Mistral Large 3 Mistral AI

39.1

Rank #176 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Mistral 7B scores higher in 0 categories and Mistral Large 3 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Mistral Large 3 leads 38.7 to 8.1.
  • Mistral 7B is cheaper at $0.25 / $0.25 per million input/output tokens, against $0.25 / $0.75 for Mistral Large 3.
  • Mistral Large 3 accepts more context: 262K tokens versus 8K.

Side by side

Mistral 7B and Mistral Large 3 specifications
Mistral 7BMistral Large 3
ProviderMistral AIMistral AI
Noometry Index23.039.1
Released2023-09-272025-12-02
WeightsOpenOpen
Context window8K262K
Max output8K8K
Input $ / M tokens$0.25$0.25
Output $ / M tokens$0.25$0.75
Results tracked3724

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large 3 leads

Mistral 7B: 26.4 (#326), Mistral Large 3: 34.4 (#237)

Coding benchmarks
BenchmarkMistral 7BMistral Large 3
LMArena Coding10821448
LMArena WebDev—1230
BigCodeBench Instruct19.5%—
BigCodeBench Complete27.3%—
HumanEval+36%—
MBPP+42.1%—

Reasoning Mistral Large 3 leads

Mistral 7B: 13.1 (#336), Mistral Large 3: 15.2 (#319)

Reasoning benchmarks
BenchmarkMistral 7BMistral Large 3
LMArena Hard Prompts10671429
Kagi LLM Benchmark—50.9%
NYT Connections (extended)—7.5%
Chess Puzzles0%—
Thematic Generalization—23%
DTBench42.5%—
Adversarial NLI47.1%—
BIG-Bench Hard56.1%—
Epoch Capabilities Index112.21—
HellaSwag81%—
PIQA83%—
WinoGrande75.3%—

Math Mistral Large 3 leads

Mistral 7B: 8.1 (#325), Mistral Large 3: 38.7 (#129)

Math benchmarks
BenchmarkMistral 7BMistral Large 3
LMArena Math10851414
OTIS Mock AIME 2024-20250.3%—
MATH Level 53.7%—
GSM8K54.4%—

Knowledge Mistral Large 3 leads

Mistral 7B: 7.4 (#311), Mistral Large 3: 36.0 (#177)

Knowledge benchmarks
BenchmarkMistral 7BMistral Large 3
LMArena Expert10361421
GPQA Diamond15.2%—
Vectara Hallucination Rate—14.5%
ARC (AI2) Challenge78.6%—
BoolQ87.4%—
MMLU62.5%—
OpenBookQA79.8%—
TriviaQA75.2%—

Multimodal Not comparable

Mistral 7B: —, Mistral Large 3: 38.2 (#66)

Multimodal benchmarks
BenchmarkMistral 7BMistral Large 3
LMArena Vision—1221

Multilingual Mistral Large 3 leads

Mistral 7B: 25.8 (#283), Mistral Large 3: 52.5 (#84)

Multilingual benchmarks
BenchmarkMistral 7BMistral Large 3
LMArena Non-English10121413
LMArena Chinese10091447
LMArena French10371455
LMArena German9871437
LMArena Japanese8781394
LMArena Russian10181411
LMArena Spanish10261440
LMArena Korean—1384

Instruction Following Mistral Large 3 leads

Mistral 7B: 54.2 (#280), Mistral Large 3: 74.0 (#108)

Instruction Following benchmarks
BenchmarkMistral 7BMistral Large 3
LMArena Instruction Following10601403

Long Context Mistral Large 3 leads

Mistral 7B: 32.2 (#271), Mistral Large 3: 43.1 (#105)

Long Context benchmarks
BenchmarkMistral 7BMistral Large 3
LMArena Longer Query10601413

Writing & Preference Mistral Large 3 leads

Mistral 7B: 30.7 (#286), Mistral Large 3: 60.0 (#101)

Writing & Preference benchmarks
BenchmarkMistral 7BMistral Large 3
LMArena Text10901428
LMArena Creative Writing10681386
LMArena Multi-Turn10621429
EQ-Bench Creative Writing—1412

Frequently asked questions

Is Mistral 7B better than Mistral Large 3?

Mistral Large 3 is the stronger model overall, scoring 39.1 to 23.0 on the Noometry Index. Mistral 7B costs 1.5× less per token, which makes it the better buy when Mistral Large 3's lead doesn't matter for your workload.

Which is cheaper, Mistral 7B or Mistral Large 3?

Mistral 7B is cheaper. It lists at $0.25 per million input tokens and $0.25 per million output tokens; Mistral Large 3 lists at $0.25 and $0.75.

Is Mistral 7B or Mistral Large 3 better for coding?

Mistral Large 3 scores higher on coding benchmarks: 34.4 versus 26.4 in the Noometry coding category.

Which has the bigger context window?

Mistral Large 3 does, with 262K tokens against 8K.

How many benchmarks do Mistral 7B and Mistral Large 3 share?

16 benchmarks have published results for both models. Mistral 7B has 37 scored results on Noometry and Mistral Large 3 has 24.

Related comparisons

Go deeper