Noometry

Model comparison

Mistral 7B vs Qwen3.5-9B

Qwen3.5-9B is the stronger model overall, scoring 33.8 to 23.0 on the Noometry Index.

Last verified . 5 shared benchmarks.

Mistral 7B Mistral AI

23.0

Rank #351 Confirmed

Qwen3.5-9B Alibaba (Qwen)

33.8

Rank #236 Confirmed

Summary

  • They share 5 benchmarks with published results for both. Mistral 7B scores higher in 0 categories and Qwen3.5-9B in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.5-9B leads 46.0 to 7.4.
  • The biggest single-benchmark swing is GPQA Diamond: 15.2% for Mistral 7B and 79% for Qwen3.5-9B.
  • Qwen3.5-9B is cheaper at $0.10 / $0.15 per million input/output tokens, against $0.25 / $0.25 for Mistral 7B.
  • Qwen3.5-9B accepts more context: 262K tokens versus 8K.

Side by side

Mistral 7BQwen3.5-9B
ProviderMistral AIAlibaba (Qwen)
Noometry Index23.033.8
Released2023-09-272026-02-23
WeightsOpenOpen
Context window8K262K
Max output8K66K
Input $ / M tokens$0.25$0.10
Output $ / M tokens$0.25$0.15
Results tracked3710

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5-9B leads

Mistral 7B: 26.4 (#326), Qwen3.5-9B: 35.9 (#217)

BenchmarkMistral 7BQwen3.5-9B
SciCode—27.5%
BigCodeBench Instruct19.5%—
LMArena Coding1082—
BigCodeBench Complete27.3%—
HumanEval+36%—
MBPP+42.1%—

Agentic & Tool Use Not comparable

Mistral 7B: —, Qwen3.5-9B: 14.5 (#151)

BenchmarkMistral 7BQwen3.5-9B
Terminal-Bench—9.2%

Reasoning Qwen3.5-9B leads

Mistral 7B: 13.1 (#336), Qwen3.5-9B: 23.1 (#182)

BenchmarkMistral 7BQwen3.5-9B
Chess Puzzles0%12%
DTBench42.5%71.2%
Epoch Capabilities Index112.21139.46
CritPt—0.3%
LMArena Hard Prompts1067—
LMCA—24.5%
Adversarial NLI47.1%—
BIG-Bench Hard56.1%—
HellaSwag81%—
PIQA83%—
WinoGrande75.3%—

Math Qwen3.5-9B leads

Mistral 7B: 8.1 (#325), Qwen3.5-9B: 34.8 (#192)

BenchmarkMistral 7BQwen3.5-9B
OTIS Mock AIME 2024-20250.3%61.7%
MathArena Final-Answer Competitions—48.5%
LMArena Math1085—
MATH Level 53.7%—
GSM8K54.4%—

Knowledge Qwen3.5-9B leads

Mistral 7B: 7.4 (#311), Qwen3.5-9B: 46.0 (#84)

BenchmarkMistral 7BQwen3.5-9B
GPQA Diamond15.2%79%
LMArena Expert1036—
ARC (AI2) Challenge78.6%—
BoolQ87.4%—
MMLU62.5%—
OpenBookQA79.8%—
TriviaQA75.2%—

Multilingual Not comparable

Mistral 7B: 25.8 (#283), Qwen3.5-9B: —

BenchmarkMistral 7BQwen3.5-9B
LMArena Non-English1012—
LMArena Chinese1009—
LMArena French1037—
LMArena German987—
LMArena Japanese878—
LMArena Russian1018—
LMArena Spanish1026—

Instruction Following Not comparable

Mistral 7B: 54.2 (#280), Qwen3.5-9B: —

BenchmarkMistral 7BQwen3.5-9B
LMArena Instruction Following1060—

Long Context Not comparable

Mistral 7B: 32.2 (#271), Qwen3.5-9B: —

BenchmarkMistral 7BQwen3.5-9B
LMArena Longer Query1060—

Writing & Preference Not comparable

Mistral 7B: 30.7 (#286), Qwen3.5-9B: —

BenchmarkMistral 7BQwen3.5-9B
LMArena Text1090—
LMArena Creative Writing1068—
LMArena Multi-Turn1062—

Frequently asked questions

Is Mistral 7B better than Qwen3.5-9B?

Qwen3.5-9B is the stronger model overall, scoring 33.8 to 23.0 on the Noometry Index.

Which is cheaper, Mistral 7B or Qwen3.5-9B?

Qwen3.5-9B is cheaper. It lists at $0.10 per million input tokens and $0.15 per million output tokens; Mistral 7B lists at $0.25 and $0.25.

Is Mistral 7B or Qwen3.5-9B better for coding?

Qwen3.5-9B scores higher on coding benchmarks: 35.9 versus 26.4 in the Noometry coding category.

Which has the bigger context window?

Qwen3.5-9B does, with 262K tokens against 8K.

How many benchmarks do Mistral 7B and Qwen3.5-9B share?

5 benchmarks have published results for both models. Mistral 7B has 37 scored results on Noometry and Qwen3.5-9B has 10.

Related comparisons

Go deeper