Model comparison

Mercury vs Qwen3.5 Plus

Qwen3.5 Plus is the stronger model overall, scoring 42.3 to 37.3 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mercury Inception

37.3

Rank #192 Confirmed

Qwen3.5 Plus Alibaba (Qwen)

42.3

Rank #103 Confirmed

Summary

  • The widest gap is in reasoning, where Qwen3.5 Plus leads 32.0 to 16.8.

Side by side

Mercury and Qwen3.5 Plus specifications
MercuryQwen3.5 Plus
ProviderInceptionAlibaba (Qwen)
Noometry Index37.342.3
Released—2026-02-16
WeightsProprietaryProprietary
Context window—1M
Max output—66K
Input $ / M tokens—$0.40
Output $ / M tokens—$2.40
Results tracked915

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mercury: 38.1 (#164), Qwen3.5 Plus: —

Coding benchmarks
BenchmarkMercuryQwen3.5 Plus
LMArena Coding1323—
ALE-Bench—621.92

Agentic & Tool Use Not comparable

Mercury: —, Qwen3.5 Plus: —

Agentic & Tool Use benchmarks
BenchmarkMercuryQwen3.5 Plus
Vending-Bench 2—0.54

Reasoning Qwen3.5 Plus leads

Mercury: 16.8 (#288), Qwen3.5 Plus: 32.0 (#67)

Reasoning benchmarks
BenchmarkMercuryQwen3.5 Plus
Kagi LLM Benchmark21.6%—
Chess Puzzles—22%
LMArena Hard Prompts1284—
Mystery Game Puzzles—17%
DTBench—80.5%
LMCA—36.4%
Epoch Capabilities Index—146.79

Math Not comparable

Mercury: —, Qwen3.5 Plus: 47.9 (#55)

Math benchmarks
BenchmarkMercuryQwen3.5 Plus
OTIS Mock AIME 2024-2025—86.7%
FrontierMath (Feb 2025 set)—21%
FrontierMath Tier 4 (v1)—2.1%

Knowledge Not comparable

Mercury: —, Qwen3.5 Plus: 46.0 (#78)

Knowledge benchmarks
BenchmarkMercuryQwen3.5 Plus
GPQA Diamond—84.8%
SimpleQA Verified—25.4%
Vectara Hallucination Rate—10.7%

Multilingual Not comparable

Mercury: 41.7 (#201), Qwen3.5 Plus: —

Multilingual benchmarks
BenchmarkMercuryQwen3.5 Plus
LMArena Non-English1259—

Instruction Following Not comparable

Mercury: 65.3 (#220), Qwen3.5 Plus: —

Instruction Following benchmarks
BenchmarkMercuryQwen3.5 Plus
LMArena Instruction Following1238—

Long Context Qwen3.5 Plus leads

Mercury: 38.3 (#193), Qwen3.5 Plus: 42.9 (#109)

Long Context benchmarks
BenchmarkMercuryQwen3.5 Plus
CL-bench—19.8%
CL-bench Life—12.4%
LMArena Longer Query1264—

Writing & Preference Not comparable

Mercury: 46.2 (#216), Qwen3.5 Plus: —

Writing & Preference benchmarks
BenchmarkMercuryQwen3.5 Plus
LMArena Text1282—
LMArena Creative Writing1186—
LMArena Multi-Turn1283—

Frequently asked questions

Is Mercury better than Qwen3.5 Plus?

Qwen3.5 Plus is the stronger model overall, scoring 42.3 to 37.3 on the Noometry Index.

How many benchmarks do Mercury and Qwen3.5 Plus share?

0 benchmarks have published results for both models. Mercury has 9 scored results on Noometry and Qwen3.5 Plus has 15.

Related comparisons

Go deeper