Model comparison

Mistral Medium 3.5 vs Qwen3-4B

Mistral Medium 3.5 is the stronger model overall, scoring 39.6 to 31.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Medium 3.5 Mistral AI

39.6

Rank #151 Confirmed

Qwen3-4B Alibaba (Qwen)

31.5

Rank #261 Confirmed

Summary

  • The widest gap is in math, where Mistral Medium 3.5 leads 36.4 to 28.5.

Side by side

Mistral Medium 3.5 and Qwen3-4B specifications
Mistral Medium 3.5Qwen3-4B
ProviderMistral AIAlibaba (Qwen)
Noometry Index39.631.5
Released—2025-04-29
WeightsOpenOpen
Context window262K—
Max output210K—
Input $ / M tokens$1.50—
Output $ / M tokens$7.50—
Results tracked226

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Medium 3.5: 35.7 (#208), Qwen3-4B: —

Coding benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
LMArena WebDev1263—
LMArena Coding1461—

Agentic & Tool Use Not comparable

Mistral Medium 3.5: —, Qwen3-4B: 27.3 (#94)

Agentic & Tool Use benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
Berkeley Function Calling Leaderboard—35.7%

Reasoning Qwen3-4B leads

Mistral Medium 3.5: 16.6 (#290), Qwen3-4B: 18.5 (#264)

Reasoning benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
Kagi LLM Benchmark41.4%—
NYT Connections (extended)12.9%—
Chess Puzzles—4%
LMArena Hard Prompts1436—
Epoch Capabilities Index141.42—

Math Mistral Medium 3.5 leads

Mistral Medium 3.5: 36.4 (#113), Qwen3-4B: 28.5 (#228)

Math benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
MathArena Final-Answer Competitions—38.5%
OTIS Mock AIME 2024-2025—52.2%
LMArena Math1432—

Knowledge Mistral Medium 3.5 leads

Mistral Medium 3.5: 39.3 (#123), Qwen3-4B: 33.0 (#198)

Knowledge benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
GPQA Diamond—52.3%
Vectara Hallucination Rate—5.7%
LMArena Expert1431—

Multimodal Not comparable

Mistral Medium 3.5: 37.6 (#64), Qwen3-4B: —

Multimodal benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
LMArena Vision1222—

Multilingual Not comparable

Mistral Medium 3.5: 52.1 (#93), Qwen3-4B: —

Multilingual benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
LMArena Non-English1405—
LMArena Chinese1443—
LMArena French1448—
LMArena German1453—
LMArena Korean1387—
LMArena Russian1396—
LMArena Spanish1406—

Instruction Following Not comparable

Mistral Medium 3.5: 74.7 (#87), Qwen3-4B: —

Instruction Following benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
LMArena Instruction Following1414—

Long Context Not comparable

Mistral Medium 3.5: 43.2 (#101), Qwen3-4B: —

Long Context benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
LMArena Longer Query1414—

Writing & Preference Not comparable

Mistral Medium 3.5: 58.6 (#113), Qwen3-4B: —

Writing & Preference benchmarks
BenchmarkMistral Medium 3.5Qwen3-4B
LMArena Text1421—
LMArena Creative Writing1372—
EQ-Bench 4993—
LMArena Multi-Turn1423—

Frequently asked questions

Is Mistral Medium 3.5 better than Qwen3-4B?

Mistral Medium 3.5 is the stronger model overall, scoring 39.6 to 31.5 on the Noometry Index.

How many benchmarks do Mistral Medium 3.5 and Qwen3-4B share?

0 benchmarks have published results for both models. Mistral Medium 3.5 has 22 scored results on Noometry and Qwen3-4B has 6.

Related comparisons

Go deeper