Model comparison
Mercury 2.5 vs Qwen3 8B
Qwen3 8B has enough public results to be ranked (#237); Mercury 2.5 does not yet, so treat this comparison as directional.
Last verified . 0 shared benchmarks.
Alibaba (Qwen)Summary
- The widest gap is in math, where Qwen3 8B leads 33.3 to 22.4.
- Mercury 2.5 is cheaper at $0.04 / $0.15 per million input/output tokens, against $0.18 / $0.70 for Qwen3 8B.
- Mercury 2.5 accepts more context: 260K tokens versus 131K.
- Qwen3 8B has downloadable open weights; the other is API-only.
Side by side
| Mercury 2.5 | Qwen3 8B | |
|---|---|---|
| Provider | Inception | Alibaba (Qwen) |
| Noometry Index | 30.2 | 33.3 |
| Released | 2026-09-08 | 2025-04 |
| Weights | Proprietary | Open |
| Context window | 260K | 131K |
| Max output | 66K | 8K |
| Input $ / M tokens | $0.04 | $0.18 |
| Output $ / M tokens | $0.15 | $0.70 |
| Results tracked | 2 | 11 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Mercury 2.5: —, Qwen3 8B: 33.4 (#245)
Agentic & Tool Use Not comparable
Mercury 2.5: —, Qwen3 8B: 29.9 (#71)
| Benchmark | Mercury 2.5 | Qwen3 8B |
|---|---|---|
| Berkeley Function Calling Leaderboard | — | 42.6% |
Reasoning Not comparable
Mercury 2.5: —, Qwen3 8B: 16.1 (#299)
| Benchmark | Mercury 2.5 | Qwen3 8B |
|---|---|---|
| CritPt | — | 0% |
| Chess Puzzles | — | 5% |
| DTBench | — | 59.7% |
| LMCA | — | 8.8% |
| Epoch Capabilities Index | — | 136.17 |
Math Qwen3 8B leads
Mercury 2.5: 22.4, Qwen3 8B: 33.3 (#176)
| Benchmark | Mercury 2.5 | Qwen3 8B |
|---|---|---|
| OTIS Mock AIME 2024-2025 | — | 56.1% |
| ProofBench | 3% | — |
Knowledge Not comparable
Mercury 2.5: —, Qwen3 8B: 36.1 (#164)
| Benchmark | Mercury 2.5 | Qwen3 8B |
|---|---|---|
| GPQA Diamond | — | 56.8% |
| Vectara Hallucination Rate | — | 4.8% |
Long Context Not comparable
Mercury 2.5: —, Qwen3 8B: 37.8 (#205)
| Benchmark | Mercury 2.5 | Qwen3 8B |
|---|---|---|
| Fiction.LiveBench | — | 62.1% |
Frequently asked questions
Is Mercury 2.5 better than Qwen3 8B?
Qwen3 8B has enough public results to be ranked (#237); Mercury 2.5 does not yet, so treat this comparison as directional.
Which is cheaper, Mercury 2.5 or Qwen3 8B?
Mercury 2.5 is cheaper. It lists at $0.04 per million input tokens and $0.15 per million output tokens; Qwen3 8B lists at $0.18 and $0.70.
Which has the bigger context window?
Mercury 2.5 does, with 260K tokens against 131K.
How many benchmarks do Mercury 2.5 and Qwen3 8B share?
0 benchmarks have published results for both models. Mercury 2.5 has 2 scored results on Noometry and Qwen3 8B has 11.