Model comparison
Codellama 70b Instruct vs Mistral Medium 3.1
Codellama 70b Instruct is the stronger model overall, scoring 33.7 to 31.9 on the Noometry Index.
Last verified . 0 shared benchmarks.
Meta
Mistral AISummary
- The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 33.4.
- Codellama 70b Instruct has downloadable open weights; the other is API-only.
Side by side
| Codellama 70b Instruct | Mistral Medium 3.1 | |
|---|---|---|
| Provider | Meta | Mistral AI |
| Noometry Index | 33.7 | 31.9 |
| Released | — | — |
| Weights | Open | Proprietary |
| Context window | — | 131K |
| Max output | — | 105K |
| Input $ / M tokens | — | $0.40 |
| Output $ / M tokens | — | $2 |
| Results tracked | 7 | 3 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Codellama 70b Instruct: 37.6 (#193), Mistral Medium 3.1: —
| Benchmark | Codellama 70b Instruct | Mistral Medium 3.1 |
|---|---|---|
| BigCodeBench Instruct | 40.7% | — |
| BigCodeBench Complete | 49.6% | — |
| HumanEval+ | 65.9% | — |
Reasoning Codellama 70b Instruct leads
Codellama 70b Instruct: 20.1 (#242), Mistral Medium 3.1: 10.6 (#341)
| Benchmark | Codellama 70b Instruct | Mistral Medium 3.1 |
|---|---|---|
| NYT Connections (extended) | — | 6.5% |
| Thematic Generalization | — | 20.3% |
| LMArena Hard Prompts | 1052 | — |
Multilingual Not comparable
Codellama 70b Instruct: 24.8 (#288), Mistral Medium 3.1: —
| Benchmark | Codellama 70b Instruct | Mistral Medium 3.1 |
|---|---|---|
| LMArena Non-English | 992 | — |
Instruction Following Not comparable
Codellama 70b Instruct: 51.9 (#293), Mistral Medium 3.1: —
| Benchmark | Codellama 70b Instruct | Mistral Medium 3.1 |
|---|---|---|
| LMArena Instruction Following | 1024 | — |
Writing & Preference Mistral Medium 3.1 leads
Codellama 70b Instruct: 33.4 (#277), Mistral Medium 3.1: 55.5 (#145)
| Benchmark | Codellama 70b Instruct | Mistral Medium 3.1 |
|---|---|---|
| LMArena Text | 1057 | — |
| EQ-Bench Creative Writing | — | 1476 |
Frequently asked questions
Is Codellama 70b Instruct better than Mistral Medium 3.1?
Codellama 70b Instruct is the stronger model overall, scoring 33.7 to 31.9 on the Noometry Index.
How many benchmarks do Codellama 70b Instruct and Mistral Medium 3.1 share?
0 benchmarks have published results for both models. Codellama 70b Instruct has 7 scored results on Noometry and Mistral Medium 3.1 has 3.