# Devstral Small 2505 vs Llama2 70b Steerlm Chat

> Devstral Small 2505 is the stronger model overall, scoring 33.9 to 31.2 on the Noometry Index.

- Canonical page: https://noometry.com/compare/devstral-small-vs-llama2-70b-steerlm-chat
- Last updated: 2026-10-10
- Shared benchmarks: 0

## Summary

- The widest gap is in coding, where Devstral Small 2505 leads 38.6 to 29.3.

## Snapshot

| | Devstral Small 2505 | Llama2 70b Steerlm Chat |
|---|---|---|
| Provider | Mistral AI | NVIDIA |
| Noometry Index | 33.9 | 31.2 |
| Rank | 228 | 265 |
| Context | 128K | — |
| Input $/M | $0.10 | — |
| Output $/M | $0.30 | — |
| Weights | Open | Open |

## Coding

- Devstral Small 2505: 38.6 (#160)
- Llama2 70b Steerlm Chat: 29.3 (#295)

| Benchmark | Devstral Small 2505 | Llama2 70b Steerlm Chat |
|---|---|---|
| SWE-bench Verified (bash only) | 56.4% | — |
| SciCode | 28.8% | — |
| LMArena Coding | — | 1025 |

## Reasoning

- Devstral Small 2505: 19.1 (#243)
- Llama2 70b Steerlm Chat: 19.1 (#245)

| Benchmark | Devstral Small 2505 | Llama2 70b Steerlm Chat |
|---|---|---|
| Kagi LLM Benchmark | 37.7% | — |
| CritPt | 0% | — |
| LMArena Hard Prompts | — | 1047 |

## Math

- Devstral Small 2505: —
- Llama2 70b Steerlm Chat: 28.8 (#223)

| Benchmark | Devstral Small 2505 | Llama2 70b Steerlm Chat |
|---|---|---|
| LMArena Math | — | 1072 |

## Multilingual

- Devstral Small 2505: —
- Llama2 70b Steerlm Chat: 28.9 (#265)

| Benchmark | Devstral Small 2505 | Llama2 70b Steerlm Chat |
|---|---|---|
| LMArena Non-English | — | 1064 |

## Instruction Following

- Devstral Small 2505: —
- Llama2 70b Steerlm Chat: 54.5 (#274)

| Benchmark | Devstral Small 2505 | Llama2 70b Steerlm Chat |
|---|---|---|
| LMArena Instruction Following | — | 1061 |

## Long Context

- Devstral Small 2505: —
- Llama2 70b Steerlm Chat: 30.4 (#283)

| Benchmark | Devstral Small 2505 | Llama2 70b Steerlm Chat |
|---|---|---|
| LMArena Longer Query | — | 998 |

## Writing & Preference

- Devstral Small 2505: —
- Llama2 70b Steerlm Chat: 31.8 (#278)

| Benchmark | Devstral Small 2505 | Llama2 70b Steerlm Chat |
|---|---|---|
| LMArena Text | — | 1098 |
| LMArena Creative Writing | — | 1091 |
| LMArena Multi-Turn | — | 1058 |

## FAQ

### Is Devstral Small 2505 better than Llama2 70b Steerlm Chat?

Devstral Small 2505 is the stronger model overall, scoring 33.9 to 31.2 on the Noometry Index.

### Is Devstral Small 2505 or Llama2 70b Steerlm Chat better for coding?

Devstral Small 2505 scores higher on coding benchmarks: 38.6 versus 29.3 in the Noometry coding category.

### How many benchmarks do Devstral Small 2505 and Llama2 70b Steerlm Chat share?

0 benchmarks have published results for both models. Devstral Small 2505 has 4 scored results on Noometry and Llama2 70b Steerlm Chat has 9.