Model comparison

Mistral Small 3.1 vs Qwen3-1.7B

Mistral Small 3.1 is the stronger model overall, scoring 31.4 to 26.2 on the Noometry Index.

Last verified . 3 shared benchmarks.

Mistral Small 3.1 Mistral AI

31.4

Rank #263 Confirmed

Qwen3-1.7B Alibaba (Qwen)

26.2

Rank #331 Reported

Summary

  • They share 3 benchmarks with published results for both. Mistral Small 3.1 scores higher in 2 categories and Qwen3-1.7B in 1 category; 2 gaps are clear of the uncertainty.

Side by side

Mistral Small 3.1 and Qwen3-1.7B specifications
Mistral Small 3.1Qwen3-1.7B
ProviderMistral AIAlibaba (Qwen)
Noometry Index31.426.2
Released2025-03-172025-04-29
WeightsOpenOpen
Context window128K—
Max output102K—
Input $ / M tokens$0.35—
Output $ / M tokens$0.56—
Results tracked284

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Small 3.1: 37.7 (#175), Qwen3-1.7B: —

Coding benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
LMArena Coding1309—

Agentic & Tool Use Not comparable

Mistral Small 3.1: —, Qwen3-1.7B: 24.5 (#108)

Agentic & Tool Use benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
Berkeley Function Calling Leaderboard—28.4%

Reasoning Too close to call

Mistral Small 3.1: 18.9 (#249), Qwen3-1.7B: 18.5 (#263)

Reasoning benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
Chess Puzzles1%0%
LMArena Hard Prompts1278—
Epoch Capabilities Index127.48—

Math Qwen3-1.7B leads

Mistral Small 3.1: 13.7 (#295), Qwen3-1.7B: 15.4 (#288)

Math benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
OTIS Mock AIME 2024-20253.9%8.1%
Omni-MATH24.8%—
LMArena Math1261—

Knowledge Mistral Small 3.1 leads

Mistral Small 3.1: 22.6 (#266), Qwen3-1.7B: 19.6 (#273)

Knowledge benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
GPQA Diamond41.9%38%
MMLU-Pro61%—
GPQA (HELM)39.2%—
LMArena Expert1258—

Multimodal Not comparable

Mistral Small 3.1: 32.6 (#93), Qwen3-1.7B: —

Multimodal benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
LMArena Vision1136—

Multilingual Not comparable

Mistral Small 3.1: 41.4 (#204), Qwen3-1.7B: —

Multilingual benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
LMArena Non-English1255—
LMArena Chinese1254—
LMArena French1270—
LMArena German1266—
LMArena Japanese1210—
LMArena Korean1206—
LMArena Russian1263—
LMArena Spanish1283—

Instruction Following Not comparable

Mistral Small 3.1: 63.8 (#225), Qwen3-1.7B: —

Instruction Following benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
IFEval75%—
LMArena Instruction Following1264—

Long Context Not comparable

Mistral Small 3.1: 39.5 (#172), Qwen3-1.7B: —

Long Context benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
LMArena Longer Query1300—

Writing & Preference Not comparable

Mistral Small 3.1: 37.2 (#254), Qwen3-1.7B: —

Writing & Preference benchmarks
BenchmarkMistral Small 3.1Qwen3-1.7B
LMArena Text1278—
LMArena Creative Writing1253—
EQ-Bench Creative Writing761—
WildBench78.8%—
LMArena Multi-Turn1270—

Frequently asked questions

Is Mistral Small 3.1 better than Qwen3-1.7B?

Mistral Small 3.1 is the stronger model overall, scoring 31.4 to 26.2 on the Noometry Index.

How many benchmarks do Mistral Small 3.1 and Qwen3-1.7B share?

3 benchmarks have published results for both models. Mistral Small 3.1 has 28 scored results on Noometry and Qwen3-1.7B has 4.

Related comparisons

Go deeper