Model comparison

Mistral Large vs Qwen3-4B

Mistral Large and Qwen3-4B score almost the same on the Noometry Index (31.9 vs 31.9), so choose on price, context window or the category you care about most.

Last verified October 10, 2026. 4 shared benchmarks.

Mistral Large

Mistral AI

31.9

Rank #263 Confirmed

Qwen3-4B

Alibaba (Qwen)

31.9

Rank #264 Confirmed

Summary

They share 4 benchmarks with published results for both. Mistral Large scores higher in 1 category and Qwen3-4B in 3 categories; 4 gaps are clear of the uncertainty.
The widest gap is in math, where Qwen3-4B leads 29.7 to 18.2.
The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 8.5% for Mistral Large and 52.2% for Qwen3-4B.

Side by side

Mistral Large and Qwen3-4B specifications
	Mistral Large	Qwen3-4B
Provider	Mistral AI	Alibaba (Qwen)
Noometry Index	31.9	31.9
Released	2024-02-26	2025-04-29
Weights	Open	Open
Context window	131K	—
Max output	16K	—
Input $ / M tokens	$2	—
Output $ / M tokens	$6	—
Results tracked	51	6

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Large: 34.3 (#240), Qwen3-4B: —

Coding benchmarks
Benchmark	Mistral Large	Qwen3-4B
SciCode	36.2%	—
BigCodeBench Instruct	30%	—
LiveBench Coding	47.1%	—
LMArena Coding	1277	—
BigCodeBench Complete	38.3%	—
ALE-Bench	264.7	—
HumanEval+	62.2%	—
MBPP+	59.5%	—

Agentic & Tool Use Mistral Large leads

Mistral Large: 28.6 (#89), Qwen3-4B: 27.6 (#100)

Agentic & Tool Use benchmarks
Benchmark	Mistral Large	Qwen3-4B
Berkeley Function Calling Leaderboard	38.4%	35.7%

Reasoning Qwen3-4B leads

Mistral Large: 15.8 (#310), Qwen3-4B: 19.2 (#268)

Reasoning benchmarks
Benchmark	Mistral Large	Qwen3-4B
SimpleBench	22.5%	—
CritPt	0%	—
Chess Puzzles	—	4%
LiveBench Reasoning	43.5%	—
LMArena Hard Prompts	1257	—
DTBench	65.1%	—
LiveBench Data Analysis	50.1%	—
LMCA	16.7%	—
Epoch Capabilities Index	128.52	—
ForecastBench	57.1	—
LiveBench	48.4%	—

Math Qwen3-4B leads

Mistral Large: 18.2 (#291), Qwen3-4B: 29.7 (#240)

Math benchmarks
Benchmark	Mistral Large	Qwen3-4B
OTIS Mock AIME 2024-2025	8.5%	52.2%
MathArena Final-Answer Competitions	—	38.5%
Omni-MATH	28.1%	—
LiveBench Math	42.5%	—
LMArena Math	1262	—
MATH Level 5	50.3%	—
FrontierMath (Feb 2025 set)	0.3%	—

Knowledge Qwen3-4B leads

Mistral Large: 30.1 (#230), Qwen3-4B: 33.0 (#208)

Knowledge benchmarks
Benchmark	Mistral Large	Qwen3-4B
GPQA Diamond	51.3%	52.3%
Vectara Hallucination Rate	4.5%	5.7%
MMLU-Pro	59.9%	—
Confabulations	21.4%	—
GPQA (HELM)	43.5%	—
LMArena Expert	1232	—
MMLU	80%	—

Multilingual Not comparable

Mistral Large: 40.0 (#219), Qwen3-4B: —

Multilingual benchmarks
Benchmark	Mistral Large	Qwen3-4B
LMArena Non-English	1237	—
LMArena Chinese	1240	—
LMArena French	1325	—
LMArena German	1254	—
LMArena Japanese	1188	—
LMArena Korean	1202	—
LMArena Russian	1257	—
LMArena Spanish	1268	—

Instruction Following Not comparable

Mistral Large: 67.9 (#191), Qwen3-4B: —

Instruction Following benchmarks
Benchmark	Mistral Large	Qwen3-4B
LiveBench Instruction Following	67.9%	—
IFEval	87.7%	—
LMArena Instruction Following	1249	—

Long Context Not comparable

Mistral Large: 38.3 (#199), Qwen3-4B: —

Long Context benchmarks
Benchmark	Mistral Large	Qwen3-4B
LMArena Longer Query	1261	—

Writing & Preference Not comparable

Mistral Large: 40.7 (#242), Qwen3-4B: —

Writing & Preference benchmarks
Benchmark	Mistral Large	Qwen3-4B
LMArena Text	1266	—
LMArena Creative Writing	1243	—
Short-Story Creative Writing	69%	—
EQ-Bench Creative Writing	985	—
WildBench	80.1%	—
LMArena Multi-Turn	1260	—
LiveBench Language	39.4%	—

Frequently asked questions

Is Mistral Large better than Qwen3-4B?