Noometry

Model comparison

Mistral Medium vs Qwen1.5-110B

Mistral Medium is the stronger model overall, scoring 36.3 to 34.2 on the Noometry Index.

Last verified . 17 shared benchmarks.

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Qwen1.5-110B Alibaba (Qwen)

34.2

Rank #234 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Mistral Medium scores higher in 6 categories and Qwen1.5-110B in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Medium leads 60.0 to 38.0.

Side by side

Mistral MediumQwen1.5-110B
ProviderMistral AIAlibaba (Qwen)
Noometry Index36.334.2
Released2023-12-112024-04-25
WeightsOpenOpen
Context window262K—
Max output262K—
Input $ / M tokens$1.50—
Output $ / M tokens$7.50—
Results tracked3620

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium leads

Mistral Medium: 34.2 (#243), Qwen1.5-110B: 33.0 (#264)

BenchmarkMistral MediumQwen1.5-110B
LMArena Coding14341184
FrontierCode8%—
SciCode40.2%—
WeirdML43.7%—
BigCodeBench Instruct—35%
BigCodeBench Complete—44.4%
ALE-Bench763.98—

Agentic & Tool Use Not comparable

Mistral Medium: 28.3 (#90), Qwen1.5-110B: —

BenchmarkMistral MediumQwen1.5-110B
Berkeley Function Calling Leaderboard37.7%—

Reasoning Mistral Medium leads

Mistral Medium: 24.0 (#167), Qwen1.5-110B: 22.7 (#189)

BenchmarkMistral MediumQwen1.5-110B
LMArena Hard Prompts14261168
Kagi LLM Benchmark50%—
CritPt0%—
DTBench75.5%—
LMCA26.1%—
Surface Evolver Bench26.9%—
ForecastBench—57.7

Math Qwen1.5-110B leads

Mistral Medium: 28.1 (#245), Qwen1.5-110B: 33.7 (#201)

BenchmarkMistral MediumQwen1.5-110B
LMArena Math14081185
OTIS Mock AIME 2024-202532.2%—
ProofBench9%—
MATH Level 581.6%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Qwen1.5-110B leads

Mistral Medium: 25.0 (#265), Qwen1.5-110B: 31.2 (#219)

BenchmarkMistral MediumQwen1.5-110B
LMArena Expert14081144
GPQA Diamond59.5%—
Humanity's Last Exam4.5%—
Vectara Hallucination Rate22.7%—

Multimodal Not comparable

Mistral Medium: 35.3 (#88), Qwen1.5-110B: —

BenchmarkMistral MediumQwen1.5-110B
LMArena Vision1172—

Multilingual Mistral Medium leads

Mistral Medium: 52.1 (#91), Qwen1.5-110B: 33.6 (#250)

BenchmarkMistral MediumQwen1.5-110B
LMArena Non-English14081142
LMArena Chinese14471206
LMArena French14591151
LMArena German14321123
LMArena Japanese13781074
LMArena Korean13801044
LMArena Russian14111118
LMArena Spanish14331142

Instruction Following Mistral Medium leads

Mistral Medium: 73.7 (#116), Qwen1.5-110B: 60.3 (#252)

BenchmarkMistral MediumQwen1.5-110B
LMArena Instruction Following13981158

Long Context Mistral Medium leads

Mistral Medium: 42.9 (#114), Qwen1.5-110B: 35.1 (#242)

BenchmarkMistral MediumQwen1.5-110B
LMArena Longer Query14061157

Writing & Preference Mistral Medium leads

Mistral Medium: 60.0 (#103), Qwen1.5-110B: 38.0 (#255)

BenchmarkMistral MediumQwen1.5-110B
LMArena Text14241175
LMArena Creative Writing13911148
LMArena Multi-Turn14181160
Short-Story Creative Writing77.3%—

Frequently asked questions

Is Mistral Medium better than Qwen1.5-110B?

Mistral Medium is the stronger model overall, scoring 36.3 to 34.2 on the Noometry Index.

Is Mistral Medium or Qwen1.5-110B better for coding?

Mistral Medium scores higher on coding benchmarks: 34.2 versus 33.0 in the Noometry coding category.

How many benchmarks do Mistral Medium and Qwen1.5-110B share?

17 benchmarks have published results for both models. Mistral Medium has 36 scored results on Noometry and Qwen1.5-110B has 20.

Related comparisons

Go deeper