Model comparison

Mistral Small 3 vs Qwen3-1.7B

Mistral Small 3 is the stronger model overall, scoring 30.9 to 26.2 on the Noometry Index.

Last verified . 3 shared benchmarks.

Mistral Small 3 Mistral AI

30.9

Rank #268 Confirmed

Qwen3-1.7B Alibaba (Qwen)

26.2

Rank #331 Reported

Summary

  • They share 3 benchmarks with published results for both. Mistral Small 3 scores higher in 1 category and Qwen3-1.7B in 2 categories; one gap is clear of the uncertainty.
  • The widest gap is in knowledge, where Mistral Small 3 leads 25.0 to 19.6.
  • The biggest single-benchmark swing is GPQA Diamond: 47.3% for Mistral Small 3 and 38% for Qwen3-1.7B.

Side by side

Mistral Small 3 and Qwen3-1.7B specifications
Mistral Small 3Qwen3-1.7B
ProviderMistral AIAlibaba (Qwen)
Noometry Index30.926.2
Released2025-01-302025-04-29
WeightsOpenOpen
Context window33K—
Max output16K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.08—
Results tracked244

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Small 3: 36.0 (#203), Qwen3-1.7B: —

Coding benchmarks
BenchmarkMistral Small 3Qwen3-1.7B
BigCodeBench Instruct45.3%—
LMArena Coding1246—
BigCodeBench Complete50.4%—

Agentic & Tool Use Not comparable

Mistral Small 3: —, Qwen3-1.7B: 24.5 (#108)

Agentic & Tool Use benchmarks
BenchmarkMistral Small 3Qwen3-1.7B
Berkeley Function Calling Leaderboard—28.4%

Reasoning Too close to call

Mistral Small 3: 18.2 (#269), Qwen3-1.7B: 18.5 (#263)

Reasoning benchmarks
BenchmarkMistral Small 3Qwen3-1.7B
Chess Puzzles0%0%
LMArena Hard Prompts1233—
Epoch Capabilities Index127.06—

Math Too close to call

Mistral Small 3: 15.3 (#290), Qwen3-1.7B: 15.4 (#288)

Math benchmarks
BenchmarkMistral Small 3Qwen3-1.7B
OTIS Mock AIME 2024-20256.7%8.1%
LMArena Math1240—

Knowledge Mistral Small 3 leads

Mistral Small 3: 25.0 (#258), Qwen3-1.7B: 19.6 (#273)

Knowledge benchmarks
BenchmarkMistral Small 3Qwen3-1.7B
GPQA Diamond47.3%38%
Confabulations25.2%—
LMArena Expert1202—

Multilingual Not comparable

Mistral Small 3: 37.5 (#231), Qwen3-1.7B: —

Multilingual benchmarks
BenchmarkMistral Small 3Qwen3-1.7B
LMArena Non-English1198—
LMArena Chinese1204—
LMArena French1202—
LMArena German1211—
LMArena Japanese1111—
LMArena Korean1188—
LMArena Russian1216—

Instruction Following Not comparable

Mistral Small 3: 63.9 (#224), Qwen3-1.7B: —

Instruction Following benchmarks
BenchmarkMistral Small 3Qwen3-1.7B
LMArena Instruction Following1214—

Long Context Not comparable

Mistral Small 3: 37.8 (#206), Qwen3-1.7B: —

Long Context benchmarks
BenchmarkMistral Small 3Qwen3-1.7B
LMArena Longer Query1246—

Writing & Preference Not comparable

Mistral Small 3: 32.4 (#275), Qwen3-1.7B: —

Writing & Preference benchmarks
BenchmarkMistral Small 3Qwen3-1.7B
LMArena Text1234—
LMArena Creative Writing1195—
EQ-Bench Creative Writing707—
LMArena Multi-Turn1217—

Frequently asked questions

Is Mistral Small 3 better than Qwen3-1.7B?

Mistral Small 3 is the stronger model overall, scoring 30.9 to 26.2 on the Noometry Index.

How many benchmarks do Mistral Small 3 and Qwen3-1.7B share?

3 benchmarks have published results for both models. Mistral Small 3 has 24 scored results on Noometry and Qwen3-1.7B has 4.

Related comparisons

Go deeper