Model comparison

Llama 3.2 1B vs Mistral Small 3.1

Mistral Small 3.1 is the stronger model overall, scoring 31.4 to 19.9 on the Noometry Index. Llama 3.2 1B costs 5.7× less per token, which makes it the better buy when Mistral Small 3.1's lead doesn't matter for your workload.

Last verified . 18 shared benchmarks.

Llama 3.2 1B Meta

19.9

Rank #349 Confirmed

Mistral Small 3.1 Mistral AI

31.4

Rank #263 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Llama 3.2 1B scores higher in 0 categories and Mistral Small 3.1 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Mistral Small 3.1 leads 41.4 to 23.9.
  • The biggest single-benchmark swing is GPQA Diamond: 23.9% for Llama 3.2 1B and 41.9% for Mistral Small 3.1.
  • Llama 3.2 1B is cheaper at $0.027 / $0.20 per million input/output tokens, against $0.35 / $0.56 for Mistral Small 3.1.
  • Mistral Small 3.1 accepts more context: 128K tokens versus 60K.

Side by side

Llama 3.2 1B and Mistral Small 3.1 specifications
Llama 3.2 1BMistral Small 3.1
ProviderMetaMistral AI
Noometry Index19.931.4
Released2024-09-242025-03-17
WeightsOpenOpen
Context window60K128K
Max output54K102K
Input $ / M tokens$0.027$0.35
Output $ / M tokens$0.20$0.56
Results tracked2228

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3.1 leads

Llama 3.2 1B: 20.6 (#333), Mistral Small 3.1: 37.7 (#175)

Coding benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
LMArena Coding10711309
BigCodeBench Instruct8.2%—
BigCodeBench Complete11.3%—

Agentic & Tool Use Not comparable

Llama 3.2 1B: 14.5 (#142), Mistral Small 3.1: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
Berkeley Function Calling Leaderboard10.8%—
BALROG6.6%—

Reasoning Mistral Small 3.1 leads

Llama 3.2 1B: 15.6 (#304), Mistral Small 3.1: 18.9 (#249)

Reasoning benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
Chess Puzzles0%1%
LMArena Hard Prompts10441278
Epoch Capabilities Index101.95127.48

Math Mistral Small 3.1 leads

Llama 3.2 1B: 9.7 (#308), Mistral Small 3.1: 13.7 (#295)

Math benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
OTIS Mock AIME 2024-20250.6%3.9%
LMArena Math10861261
Omni-MATH—24.8%

Knowledge Mistral Small 3.1 leads

Llama 3.2 1B: 7.2 (#307), Mistral Small 3.1: 22.6 (#266)

Knowledge benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
GPQA Diamond23.9%41.9%
LMArena Expert10071258
MMLU-Pro—61%
GPQA (HELM)—39.2%

Multimodal Not comparable

Llama 3.2 1B: —, Mistral Small 3.1: 32.6 (#93)

Multimodal benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
LMArena Vision—1136

Multilingual Mistral Small 3.1 leads

Llama 3.2 1B: 23.9 (#287), Mistral Small 3.1: 41.4 (#204)

Multilingual benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
LMArena Non-English9731255
LMArena Chinese9581254
LMArena German10141266
LMArena Russian9411263
LMArena French—1270
LMArena Japanese—1210
LMArena Korean—1206
LMArena Spanish—1283

Instruction Following Mistral Small 3.1 leads

Llama 3.2 1B: 52.6 (#285), Mistral Small 3.1: 63.8 (#225)

Instruction Following benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
LMArena Instruction Following10311264
IFEval—75%

Long Context Mistral Small 3.1 leads

Llama 3.2 1B: 31.9 (#269), Mistral Small 3.1: 39.5 (#172)

Long Context benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
LMArena Longer Query10501300

Writing & Preference Mistral Small 3.1 leads

Llama 3.2 1B: 21.4 (#305), Mistral Small 3.1: 37.2 (#254)

Writing & Preference benchmarks
BenchmarkLlama 3.2 1BMistral Small 3.1
LMArena Text10551278
LMArena Creative Writing10331253
EQ-Bench Creative Writing200761
LMArena Multi-Turn10301270
WildBench—78.8%

Frequently asked questions

Is Llama 3.2 1B better than Mistral Small 3.1?

Mistral Small 3.1 is the stronger model overall, scoring 31.4 to 19.9 on the Noometry Index. Llama 3.2 1B costs 5.7× less per token, which makes it the better buy when Mistral Small 3.1's lead doesn't matter for your workload.

Which is cheaper, Llama 3.2 1B or Mistral Small 3.1?

Llama 3.2 1B is cheaper. It lists at $0.027 per million input tokens and $0.20 per million output tokens; Mistral Small 3.1 lists at $0.35 and $0.56.

Is Llama 3.2 1B or Mistral Small 3.1 better for coding?

Mistral Small 3.1 scores higher on coding benchmarks: 37.7 versus 20.6 in the Noometry coding category.

Which has the bigger context window?

Mistral Small 3.1 does, with 128K tokens against 60K.

How many benchmarks do Llama 3.2 1B and Mistral Small 3.1 share?

18 benchmarks have published results for both models. Llama 3.2 1B has 22 scored results on Noometry and Mistral Small 3.1 has 28.

Related comparisons

Go deeper