Model comparison

Mistral Large vs Qwen3-1.7B

Mistral Large is the stronger model overall, scoring 31.9 to 26.6 on the Noometry Index.

Last verified October 10, 2026. 3 shared benchmarks.

Mistral Large

Mistral AI

31.9

Rank #263 Confirmed

Qwen3-1.7B

Alibaba (Qwen)

26.6

Rank #336 Reported

Summary

They share 3 benchmarks with published results for both. Mistral Large scores higher in 3 categories and Qwen3-1.7B in 1 category; 4 gaps are clear of the uncertainty.
The widest gap is in knowledge, where Mistral Large leads 30.1 to 19.6.
The biggest single-benchmark swing is GPQA Diamond: 51.3% for Mistral Large and 38% for Qwen3-1.7B.

Side by side

Mistral Large and Qwen3-1.7B specifications
	Mistral Large	Qwen3-1.7B
Provider	Mistral AI	Alibaba (Qwen)
Noometry Index	31.9	26.6
Released	2024-02-26	2025-04-29
Weights	Open	Open
Context window	131K	—
Max output	16K	—
Input $ / M tokens	$2	—
Output $ / M tokens	$6	—
Results tracked	51	4

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Large: 34.3 (#240), Qwen3-1.7B: —

Coding benchmarks
Benchmark	Mistral Large	Qwen3-1.7B
SciCode	36.2%	—
BigCodeBench Instruct	30%	—
LiveBench Coding	47.1%	—
LMArena Coding	1277	—
BigCodeBench Complete	38.3%	—
ALE-Bench	264.7	—
HumanEval+	62.2%	—
MBPP+	59.5%	—

Agentic & Tool Use Mistral Large leads

Mistral Large: 28.6 (#89), Qwen3-1.7B: 24.7 (#115)

Agentic & Tool Use benchmarks
Benchmark	Mistral Large	Qwen3-1.7B
Berkeley Function Calling Leaderboard	38.4%	28.4%

Reasoning Qwen3-1.7B leads

Mistral Large: 15.8 (#310), Qwen3-1.7B: 19.2 (#267)

Reasoning benchmarks
Benchmark	Mistral Large	Qwen3-1.7B
SimpleBench	22.5%	—
CritPt	0%	—
Chess Puzzles	—	0%
LiveBench Reasoning	43.5%	—
LMArena Hard Prompts	1257	—
DTBench	65.1%	—
LiveBench Data Analysis	50.1%	—
LMCA	16.7%	—
Epoch Capabilities Index	128.52	—
ForecastBench	57.1	—
LiveBench	48.4%	—

Math Mistral Large leads

Mistral Large: 18.2 (#291), Qwen3-1.7B: 16.3 (#294)

Math benchmarks
Benchmark	Mistral Large	Qwen3-1.7B
OTIS Mock AIME 2024-2025	8.5%	8.1%
Omni-MATH	28.1%	—
LiveBench Math	42.5%	—
LMArena Math	1262	—
MATH Level 5	50.3%	—
FrontierMath (Feb 2025 set)	0.3%	—

Knowledge Mistral Large leads

Mistral Large: 30.1 (#230), Qwen3-1.7B: 19.6 (#278)

Knowledge benchmarks
Benchmark	Mistral Large	Qwen3-1.7B
GPQA Diamond	51.3%	38%
MMLU-Pro	59.9%	—
Confabulations	21.4%	—
Vectara Hallucination Rate	4.5%	—
GPQA (HELM)	43.5%	—
LMArena Expert	1232	—
MMLU	80%	—

Multilingual Not comparable

Mistral Large: 40.0 (#219), Qwen3-1.7B: —

Multilingual benchmarks
Benchmark	Mistral Large	Qwen3-1.7B
LMArena Non-English	1237	—
LMArena Chinese	1240	—
LMArena French	1325	—
LMArena German	1254	—
LMArena Japanese	1188	—
LMArena Korean	1202	—
LMArena Russian	1257	—
LMArena Spanish	1268	—

Instruction Following Not comparable

Mistral Large: 67.9 (#191), Qwen3-1.7B: —

Instruction Following benchmarks
Benchmark	Mistral Large	Qwen3-1.7B
LiveBench Instruction Following	67.9%	—
IFEval	87.7%	—
LMArena Instruction Following	1249	—

Long Context Not comparable

Mistral Large: 38.3 (#199), Qwen3-1.7B: —

Long Context benchmarks
Benchmark	Mistral Large	Qwen3-1.7B
LMArena Longer Query	1261	—

Writing & Preference Not comparable

Mistral Large: 40.7 (#242), Qwen3-1.7B: —

Writing & Preference benchmarks
Benchmark	Mistral Large	Qwen3-1.7B
LMArena Text	1266	—
LMArena Creative Writing	1243	—
Short-Story Creative Writing	69%	—
EQ-Bench Creative Writing	985	—
WildBench	80.1%	—
LMArena Multi-Turn	1260	—
LiveBench Language	39.4%	—

Frequently asked questions

Is Mistral Large better than Qwen3-1.7B?