Model comparison

Llama 3.2 1B vs Mistral Medium 3.5

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 20.1 on the Noometry Index. Llama 3.2 1B costs 43× less per token, which makes it the better buy when Mistral Medium 3.5's lead doesn't matter for your workload.

Last verified . 14 shared benchmarks.

Llama 3.2 1B Meta

20.1

Rank #354 Confirmed

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Llama 3.2 1B scores higher in 0 categories and Mistral Medium 3.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Medium 3.5 leads 58.5 to 21.3.
  • Llama 3.2 1B is cheaper at $0.027 / $0.20 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium 3.5.
  • Mistral Medium 3.5 accepts more context: 262K tokens versus 60K.

Side by side

Llama 3.2 1B and Mistral Medium 3.5 specifications
Llama 3.2 1BMistral Medium 3.5
ProviderMetaMistral AI
Noometry Index20.140.2
Released2024-09-24—
WeightsOpenOpen
Context window60K262K
Max output54K210K
Input $ / M tokens$0.027$1.50
Output $ / M tokens$0.20$7.50
Results tracked2222

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium 3.5 leads

Llama 3.2 1B: 21.1 (#338), Mistral Medium 3.5: 36.0 (#213)

Coding benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
LMArena Coding10701461
LMArena WebDev—1264
BigCodeBench Instruct8.2%—
BigCodeBench Complete11.3%—

Agentic & Tool Use Not comparable

Llama 3.2 1B: 14.6 (#150), Mistral Medium 3.5: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
Berkeley Function Calling Leaderboard10.8%—
BALROG6.6%—

Reasoning Mistral Medium 3.5 leads

Llama 3.2 1B: 16.2 (#308), Mistral Medium 3.5: 17.3 (#295)

Reasoning benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
LMArena Hard Prompts10441436
Epoch Capabilities Index101.99141.35
Kagi LLM Benchmark—41.4%
NYT Connections (extended)—12.9%
Chess Puzzles0%—

Math Mistral Medium 3.5 leads

Llama 3.2 1B: 10.4 (#313), Mistral Medium 3.5: 39.1 (#113)

Math benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
LMArena Math10861431
OTIS Mock AIME 2024-20250.6%—

Knowledge Mistral Medium 3.5 leads

Llama 3.2 1B: 7.2 (#312), Mistral Medium 3.5: 40.0 (#126)

Knowledge benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
LMArena Expert10071432
GPQA Diamond23.9%—

Multimodal Not comparable

Llama 3.2 1B: —, Mistral Medium 3.5: 38.3 (#65)

Multimodal benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
LMArena Vision—1223

Multilingual Mistral Medium 3.5 leads

Llama 3.2 1B: 23.8 (#292), Mistral Medium 3.5: 51.9 (#100)

Multilingual benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
LMArena Non-English9731404
LMArena Chinese9591442
LMArena German10141451
LMArena Russian9411395
LMArena French—1448
LMArena Korean—1385
LMArena Spanish—1409

Instruction Following Mistral Medium 3.5 leads

Llama 3.2 1B: 52.4 (#290), Mistral Medium 3.5: 74.6 (#90)

Instruction Following benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
LMArena Instruction Following10311415

Long Context Mistral Medium 3.5 leads

Llama 3.2 1B: 31.9 (#274), Mistral Medium 3.5: 43.2 (#103)

Long Context benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
LMArena Longer Query10501415

Writing & Preference Mistral Medium 3.5 leads

Llama 3.2 1B: 21.3 (#310), Mistral Medium 3.5: 58.5 (#117)

Writing & Preference benchmarks
BenchmarkLlama 3.2 1BMistral Medium 3.5
LMArena Text10551421
LMArena Creative Writing10331374
LMArena Multi-Turn10301423
EQ-Bench Creative Writing200—
EQ-Bench 4—993

Frequently asked questions

Is Llama 3.2 1B better than Mistral Medium 3.5?

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 20.1 on the Noometry Index. Llama 3.2 1B costs 43× less per token, which makes it the better buy when Mistral Medium 3.5's lead doesn't matter for your workload.

Which is cheaper, Llama 3.2 1B or Mistral Medium 3.5?

Llama 3.2 1B is cheaper. It lists at $0.027 per million input tokens and $0.20 per million output tokens; Mistral Medium 3.5 lists at $1.50 and $7.50.

Is Llama 3.2 1B or Mistral Medium 3.5 better for coding?

Mistral Medium 3.5 scores higher on coding benchmarks: 36.0 versus 21.1 in the Noometry coding category.

Which has the bigger context window?

Mistral Medium 3.5 does, with 262K tokens against 60K.

How many benchmarks do Llama 3.2 1B and Mistral Medium 3.5 share?

14 benchmarks have published results for both models. Llama 3.2 1B has 22 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper