Model comparison
Mixtral 8x7B vs Nova 2.0 Pro Preview
Nova 2.0 Pro Preview is the stronger model overall, scoring 33.4 to 27.1 on the Noometry Index.
Last verified . 0 shared benchmarks.
Mistral AISummary
- The widest gap is in coding, where Nova 2.0 Pro Preview leads 40.8 to 32.8.
- Mixtral 8x7B has downloadable open weights; the other is API-only.
Side by side
| Mixtral 8x7B | Nova 2.0 Pro Preview | |
|---|---|---|
| Provider | Mistral AI | Amazon |
| Noometry Index | 27.1 | 33.4 |
| Released | 2023-12-11 | 2025-12-02 |
| Weights | Open | Proprietary |
| Context window | 32K | — |
| Max output | 32K | — |
| Input $ / M tokens | $0.70 | — |
| Output $ / M tokens | $0.70 | — |
| Results tracked | 38 | 3 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Nova 2.0 Pro Preview leads
Mixtral 8x7B: 32.8 (#269), Nova 2.0 Pro Preview: 40.8 (#133)
| Benchmark | Mixtral 8x7B | Nova 2.0 Pro Preview |
|---|---|---|
| SciCode | — | 42.7% |
| LMArena Coding | 1126 | — |
| HumanEval+ | 39.6% | — |
| MBPP+ | 49.7% | — |
Agentic & Tool Use Not comparable
Mixtral 8x7B: —, Nova 2.0 Pro Preview: 21.9 (#136)
| Benchmark | Mixtral 8x7B | Nova 2.0 Pro Preview |
|---|---|---|
| GDP.pdf | — | 2% |
Reasoning Nova 2.0 Pro Preview leads
Mixtral 8x7B: 18.2 (#285), Nova 2.0 Pro Preview: 22.4 (#194)
| Benchmark | Mixtral 8x7B | Nova 2.0 Pro Preview |
|---|---|---|
| CritPt | — | 0% |
| LMArena Hard Prompts | 1115 | — |
| DTBench | 49.6% | — |
| Adversarial NLI | 55.2% | — |
| Epoch Capabilities Index | 118.47 | — |
| ForecastBench | 56.3 | — |
| HellaSwag | 86.7% | — |
| PIQA | 83.6% | — |
| WinoGrande | 77.2% | — |
Math Not comparable
Mixtral 8x7B: 18.8 (#289), Nova 2.0 Pro Preview: —
| Benchmark | Mixtral 8x7B | Nova 2.0 Pro Preview |
|---|---|---|
| Omni-MATH | 10.5% | — |
| LMArena Math | 1147 | — |
| MATH Level 5 | 10% | — |
| GSM8K | 74.4% | — |
Knowledge Not comparable
Mixtral 8x7B: 11.0 (#301), Nova 2.0 Pro Preview: —
| Benchmark | Mixtral 8x7B | Nova 2.0 Pro Preview |
|---|---|---|
| GPQA Diamond | 30.6% | — |
| MMLU-Pro | 33.5% | — |
| GPQA (HELM) | 29.6% | — |
| LMArena Expert | 1088 | — |
| ARC (AI2) Challenge | 87.3% | — |
| MMLU | 70.6% | — |
| OpenBookQA | 85.8% | — |
| TriviaQA | 82.2% | — |
Multilingual Not comparable
Mixtral 8x7B: 29.6 (#266), Nova 2.0 Pro Preview: —
| Benchmark | Mixtral 8x7B | Nova 2.0 Pro Preview |
|---|---|---|
| LMArena Non-English | 1077 | — |
| LMArena Chinese | 1055 | — |
| LMArena French | 1166 | — |
| LMArena German | 1114 | — |
| LMArena Japanese | 931 | — |
| LMArena Korean | 968 | — |
| LMArena Russian | 1090 | — |
| LMArena Spanish | 1111 | — |
Instruction Following Not comparable
Mixtral 8x7B: 51.0 (#297), Nova 2.0 Pro Preview: —
| Benchmark | Mixtral 8x7B | Nova 2.0 Pro Preview |
|---|---|---|
| IFEval | 57.5% | — |
| LMArena Instruction Following | 1109 | — |
Long Context Not comparable
Mixtral 8x7B: 33.4 (#260), Nova 2.0 Pro Preview: —
| Benchmark | Mixtral 8x7B | Nova 2.0 Pro Preview |
|---|---|---|
| LMArena Longer Query | 1103 | — |
Writing & Preference Not comparable
Mixtral 8x7B: 34.2 (#270), Nova 2.0 Pro Preview: —
| Benchmark | Mixtral 8x7B | Nova 2.0 Pro Preview |
|---|---|---|
| LMArena Text | 1132 | — |
| LMArena Creative Writing | 1109 | — |
| WildBench | 67.3% | — |
| LMArena Multi-Turn | 1115 | — |
Frequently asked questions
Is Mixtral 8x7B better than Nova 2.0 Pro Preview?
Nova 2.0 Pro Preview is the stronger model overall, scoring 33.4 to 27.1 on the Noometry Index.
Is Mixtral 8x7B or Nova 2.0 Pro Preview better for coding?
Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.8 versus 32.8 in the Noometry coding category.
How many benchmarks do Mixtral 8x7B and Nova 2.0 Pro Preview share?
0 benchmarks have published results for both models. Mixtral 8x7B has 38 scored results on Noometry and Nova 2.0 Pro Preview has 3.