Model comparison

Mistral Nemo vs Qwen Max

Qwen Max is the stronger model overall, scoring 34.7 to 26.4 on the Noometry Index. Mistral Nemo costs 19× less per token, which makes it the better buy when Qwen Max's lead doesn't matter for your workload.

Last verified . 2 shared benchmarks.

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Mistral Nemo scores higher in 1 category and Qwen Max in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen Max leads 47.8 to 28.5.
  • The biggest single-benchmark swing is MATH Level 5: 10.8% for Mistral Nemo and 67.2% for Qwen Max.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $1.60 / $6.40 for Qwen Max.
  • Mistral Nemo accepts more context: 128K tokens versus 33K.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Mistral Nemo and Qwen Max specifications
Mistral NemoQwen Max
ProviderMistral AIAlibaba (Qwen)
Noometry Index26.434.7
Released2024-07-012024-04-03
WeightsOpenProprietary
Context window128K33K
Max output128K8K
Input $ / M tokens$0.15$1.60
Output $ / M tokens$0.15$6.40
Results tracked1023

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Nemo: —, Qwen Max: 30.7 (#292)

Coding benchmarks
BenchmarkMistral NemoQwen Max
Aider Polyglot—21.8%
LMArena Coding—1288

Agentic & Tool Use Not comparable

Mistral Nemo: 23.5 (#125), Qwen Max: —

Agentic & Tool Use benchmarks
BenchmarkMistral NemoQwen Max
Berkeley Function Calling Leaderboard27.6%—
BALROG17.6%—

Reasoning Qwen Max leads

Mistral Nemo: 20.7 (#232), Qwen Max: 25.1 (#151)

Reasoning benchmarks
BenchmarkMistral NemoQwen Max
LMArena Hard Prompts—1269
DTBench48.6%—
Epoch Capabilities Index118.68—
PIQA83.5%—

Math Mistral Nemo leads

Mistral Nemo: 25.5 (#268), Qwen Max: 22.3 (#276)

Math benchmarks
BenchmarkMistral NemoQwen Max
MATH Level 510.8%67.2%
OTIS Mock AIME 2024-2025—16.1%
LMArena Math—1275
FrontierMath (Feb 2025 set)—1%
GSM8K84.2%—

Knowledge Qwen Max leads

Mistral Nemo: 12.3 (#298), Qwen Max: 30.3 (#228)

Knowledge benchmarks
BenchmarkMistral NemoQwen Max
GPQA Diamond29.9%56.1%
LMArena Expert—1248
BoolQ82.5%—

Multilingual Not comparable

Mistral Nemo: —, Qwen Max: 41.8 (#202)

Multilingual benchmarks
BenchmarkMistral NemoQwen Max
LMArena Non-English—1263
LMArena Chinese—1254
LMArena French—1330
LMArena German—1254
LMArena Japanese—1205
LMArena Korean—1142
LMArena Russian—1274
LMArena Spanish—1290

Instruction Following Not comparable

Mistral Nemo: —, Qwen Max: 66.5 (#208)

Instruction Following benchmarks
BenchmarkMistral NemoQwen Max
LMArena Instruction Following—1262

Long Context Not comparable

Mistral Nemo: —, Qwen Max: 39.4 (#180)

Long Context benchmarks
BenchmarkMistral NemoQwen Max
Fiction.LiveBench—66.7%
LMArena Longer Query—1288

Writing & Preference Qwen Max leads

Mistral Nemo: 28.5 (#296), Qwen Max: 47.8 (#205)

Writing & Preference benchmarks
BenchmarkMistral NemoQwen Max
LMArena Text—1282
LMArena Creative Writing—1248
EQ-Bench Creative Writing881—
LMArena Multi-Turn—1277

Frequently asked questions

Is Mistral Nemo better than Qwen Max?

Qwen Max is the stronger model overall, scoring 34.7 to 26.4 on the Noometry Index. Mistral Nemo costs 19× less per token, which makes it the better buy when Qwen Max's lead doesn't matter for your workload.

Which is cheaper, Mistral Nemo or Qwen Max?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Qwen Max lists at $1.60 and $6.40.

Which has the bigger context window?

Mistral Nemo does, with 128K tokens against 33K.

How many benchmarks do Mistral Nemo and Qwen Max share?

2 benchmarks have published results for both models. Mistral Nemo has 10 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper