Noometry

Model comparison

Mistral 7B vs Qwen3.7 Flash

Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 23.0 on the Noometry Index.

Last verified . 4 shared benchmarks.

Mistral 7B Mistral AI

23.0

Rank #351 Confirmed

Qwen3.7 Flash Alibaba (Qwen)

39.9

Rank #156 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Mistral 7B scores higher in 0 categories and Qwen3.7 Flash in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Flash leads 48.9 to 7.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 0.3% for Mistral 7B and 86.7% for Qwen3.7 Flash.
  • Qwen3.7 Flash is cheaper at $0.03 / $0.13 per million input/output tokens, against $0.25 / $0.25 for Mistral 7B.
  • Qwen3.7 Flash accepts more context: 1M tokens versus 8K.
  • Mistral 7B has downloadable open weights; the other is API-only.

Side by side

Mistral 7BQwen3.7 Flash
ProviderMistral AIAlibaba (Qwen)
Noometry Index23.039.9
Released2023-09-272026-07-15
WeightsOpenProprietary
Context window8K1M
Max output8K131K
Input $ / M tokens$0.25$0.03
Output $ / M tokens$0.25$0.13
Results tracked377

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral 7B: 26.4 (#326), Qwen3.7 Flash: —

BenchmarkMistral 7BQwen3.7 Flash
BigCodeBench Instruct19.5%—
LMArena Coding1082—
BigCodeBench Complete27.3%—
HumanEval+36%—
MBPP+42.1%—

Reasoning Qwen3.7 Flash leads

Mistral 7B: 13.1 (#336), Qwen3.7 Flash: 28.2 (#108)

BenchmarkMistral 7BQwen3.7 Flash
Chess Puzzles0%23%
Epoch Capabilities Index112.21144.64
NYT Connections (extended)—43.8%
LMArena Hard Prompts1067—
Mystery Game Puzzles—15%
DTBench42.5%—
Adversarial NLI47.1%—
BIG-Bench Hard56.1%—
HellaSwag81%—
PIQA83%—
WinoGrande75.3%—

Math Qwen3.7 Flash leads

Mistral 7B: 8.1 (#325), Qwen3.7 Flash: 38.3 (#140)

BenchmarkMistral 7BQwen3.7 Flash
OTIS Mock AIME 2024-20250.3%86.7%
FrontierMath (Tiers 1-3)—19.3%
LMArena Math1085—
MATH Level 53.7%—
GSM8K54.4%—

Knowledge Qwen3.7 Flash leads

Mistral 7B: 7.4 (#311), Qwen3.7 Flash: 48.9 (#75)

BenchmarkMistral 7BQwen3.7 Flash
GPQA Diamond15.2%82.3%
LMArena Expert1036—
ARC (AI2) Challenge78.6%—
BoolQ87.4%—
MMLU62.5%—
OpenBookQA79.8%—
TriviaQA75.2%—

Multilingual Not comparable

Mistral 7B: 25.8 (#283), Qwen3.7 Flash: —

BenchmarkMistral 7BQwen3.7 Flash
LMArena Non-English1012—
LMArena Chinese1009—
LMArena French1037—
LMArena German987—
LMArena Japanese878—
LMArena Russian1018—
LMArena Spanish1026—

Instruction Following Not comparable

Mistral 7B: 54.2 (#280), Qwen3.7 Flash: —

BenchmarkMistral 7BQwen3.7 Flash
LMArena Instruction Following1060—

Long Context Not comparable

Mistral 7B: 32.2 (#271), Qwen3.7 Flash: —

BenchmarkMistral 7BQwen3.7 Flash
LMArena Longer Query1060—

Writing & Preference Not comparable

Mistral 7B: 30.7 (#286), Qwen3.7 Flash: —

BenchmarkMistral 7BQwen3.7 Flash
LMArena Text1090—
LMArena Creative Writing1068—
LMArena Multi-Turn1062—

Frequently asked questions

Is Mistral 7B better than Qwen3.7 Flash?

Qwen3.7 Flash is the stronger model overall, scoring 39.9 to 23.0 on the Noometry Index.

Which is cheaper, Mistral 7B or Qwen3.7 Flash?

Qwen3.7 Flash is cheaper. It lists at $0.03 per million input tokens and $0.13 per million output tokens; Mistral 7B lists at $0.25 and $0.25.

Which has the bigger context window?

Qwen3.7 Flash does, with 1M tokens against 8K.

How many benchmarks do Mistral 7B and Qwen3.7 Flash share?

4 benchmarks have published results for both models. Mistral 7B has 37 scored results on Noometry and Qwen3.7 Flash has 7.

Related comparisons

Go deeper