Model comparison
Mistral 7B vs Qwen3.5 Max Preview
Qwen3.5 Max Preview is the stronger model overall, scoring 45.3 to 23.0 on the Noometry Index.
Last verified . 16 shared benchmarks.
Mistral AI
Alibaba (Qwen)Summary
- They share 16 benchmarks with published results for both. Mistral 7B scores higher in 0 categories and Qwen3.5 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
- The widest gap is in writing & preference, where Qwen3.5 Max Preview leads 66.0 to 30.7.
- Mistral 7B has downloadable open weights; the other is API-only.
Side by side
| Mistral 7B | Qwen3.5 Max Preview | |
|---|---|---|
| Provider | Mistral AI | Alibaba (Qwen) |
| Noometry Index | 23.0 | 45.3 |
| Released | 2023-09-27 | — |
| Weights | Open | Proprietary |
| Context window | 8K | — |
| Max output | 8K | — |
| Input $ / M tokens | $0.25 | — |
| Output $ / M tokens | $0.25 | — |
| Results tracked | 37 | 17 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Qwen3.5 Max Preview leads
Mistral 7B: 26.4 (#326), Qwen3.5 Max Preview: 44.0 (#77)
| Benchmark | Mistral 7B | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Coding | 1082 | 1487 |
| BigCodeBench Instruct | 19.5% | — |
| BigCodeBench Complete | 27.3% | — |
| HumanEval+ | 36% | — |
| MBPP+ | 42.1% | — |
Reasoning Qwen3.5 Max Preview leads
Mistral 7B: 13.1 (#336), Qwen3.5 Max Preview: 30.8 (#84)
| Benchmark | Mistral 7B | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Hard Prompts | 1067 | 1483 |
| Chess Puzzles | 0% | — |
| DTBench | 42.5% | — |
| Adversarial NLI | 47.1% | — |
| BIG-Bench Hard | 56.1% | — |
| Epoch Capabilities Index | 112.21 | — |
| HellaSwag | 81% | — |
| PIQA | 83% | — |
| WinoGrande | 75.3% | — |
Math Qwen3.5 Max Preview leads
Mistral 7B: 8.1 (#325), Qwen3.5 Max Preview: 40.1 (#94)
| Benchmark | Mistral 7B | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Math | 1085 | 1474 |
| OTIS Mock AIME 2024-2025 | 0.3% | — |
| MATH Level 5 | 3.7% | — |
| GSM8K | 54.4% | — |
Knowledge Qwen3.5 Max Preview leads
Mistral 7B: 7.4 (#311), Qwen3.5 Max Preview: 41.8 (#107)
| Benchmark | Mistral 7B | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Expert | 1036 | 1489 |
| GPQA Diamond | 15.2% | — |
| ARC (AI2) Challenge | 78.6% | — |
| BoolQ | 87.4% | — |
| MMLU | 62.5% | — |
| OpenBookQA | 79.8% | — |
| TriviaQA | 75.2% | — |
Multilingual Qwen3.5 Max Preview leads
Mistral 7B: 25.8 (#283), Qwen3.5 Max Preview: 56.2 (#22)
| Benchmark | Mistral 7B | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Non-English | 1012 | 1465 |
| LMArena Chinese | 1009 | 1534 |
| LMArena French | 1037 | 1484 |
| LMArena German | 987 | 1487 |
| LMArena Japanese | 878 | 1495 |
| LMArena Russian | 1018 | 1471 |
| LMArena Spanish | 1026 | 1470 |
| LMArena Korean | — | 1438 |
Instruction Following Qwen3.5 Max Preview leads
Mistral 7B: 54.2 (#280), Qwen3.5 Max Preview: 77.0 (#31)
| Benchmark | Mistral 7B | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Instruction Following | 1060 | 1467 |
Long Context Qwen3.5 Max Preview leads
Mistral 7B: 32.2 (#271), Qwen3.5 Max Preview: 45.2 (#45)
| Benchmark | Mistral 7B | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Longer Query | 1060 | 1476 |
Writing & Preference Qwen3.5 Max Preview leads
Mistral 7B: 30.7 (#286), Qwen3.5 Max Preview: 66.0 (#41)
| Benchmark | Mistral 7B | Qwen3.5 Max Preview |
|---|---|---|
| LMArena Text | 1090 | 1470 |
| LMArena Creative Writing | 1068 | 1464 |
| LMArena Multi-Turn | 1062 | 1478 |
Frequently asked questions
Is Mistral 7B better than Qwen3.5 Max Preview?
Qwen3.5 Max Preview is the stronger model overall, scoring 45.3 to 23.0 on the Noometry Index.
Is Mistral 7B or Qwen3.5 Max Preview better for coding?
Qwen3.5 Max Preview scores higher on coding benchmarks: 44.0 versus 26.4 in the Noometry coding category.
How many benchmarks do Mistral 7B and Qwen3.5 Max Preview share?
16 benchmarks have published results for both models. Mistral 7B has 37 scored results on Noometry and Qwen3.5 Max Preview has 17.