Model comparison

Qwen3-1.7B vs Yi-1.5-34B

Yi-1.5-34B is the stronger model overall, scoring 30.6 to 26.6 on the Noometry Index.

Last verified . 1 shared benchmarks.

Qwen3-1.7B Alibaba (Qwen)

26.6

Rank #336 Reported

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Summary

  • They share 1 benchmark with published results for both. Qwen3-1.7B scores higher in 1 category and Yi-1.5-34B in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Yi-1.5-34B leads 27.5 to 16.3.
  • The biggest single-benchmark swing is GPQA Diamond: 38% for Qwen3-1.7B and 32% for Yi-1.5-34B.

Side by side

Qwen3-1.7B and Yi-1.5-34B specifications
Qwen3-1.7BYi-1.5-34B
ProviderAlibaba (Qwen)01.AI
Noometry Index26.630.6
Released2025-04-292024-05-13
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked421

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen3-1.7B: —, Yi-1.5-34B: 32.4 (#272)

Coding benchmarks
BenchmarkQwen3-1.7BYi-1.5-34B
BigCodeBench Instruct—33.9%
LMArena Coding—1169
BigCodeBench Complete—43.8%

Agentic & Tool Use Not comparable

Qwen3-1.7B: 24.7 (#115), Yi-1.5-34B: —

Agentic & Tool Use benchmarks
BenchmarkQwen3-1.7BYi-1.5-34B
Berkeley Function Calling Leaderboard28.4%—

Reasoning Yi-1.5-34B leads

Qwen3-1.7B: 19.2 (#267), Yi-1.5-34B: 22.5 (#191)

Reasoning benchmarks
BenchmarkQwen3-1.7BYi-1.5-34B
Chess Puzzles0%—
LMArena Hard Prompts—1160

Math Yi-1.5-34B leads

Qwen3-1.7B: 16.3 (#294), Yi-1.5-34B: 27.5 (#249)

Math benchmarks
BenchmarkQwen3-1.7BYi-1.5-34B
OTIS Mock AIME 2024-20258.1%—
LMArena Math—1182
MATH Level 5—25.5%

Knowledge Qwen3-1.7B leads

Qwen3-1.7B: 19.6 (#278), Yi-1.5-34B: 14.8 (#295)

Knowledge benchmarks
BenchmarkQwen3-1.7BYi-1.5-34B
GPQA Diamond38%32%
LMArena Expert—1144

Multilingual Not comparable

Qwen3-1.7B: —, Yi-1.5-34B: 32.3 (#256)

Multilingual benchmarks
BenchmarkQwen3-1.7BYi-1.5-34B
LMArena Non-English—1121
LMArena Chinese—1213
LMArena French—1156
LMArena German—1111
LMArena Japanese—1021
LMArena Korean—1005
LMArena Russian—1091
LMArena Spanish—1121

Instruction Following Not comparable

Qwen3-1.7B: —, Yi-1.5-34B: 59.2 (#257)

Instruction Following benchmarks
BenchmarkQwen3-1.7BYi-1.5-34B
LMArena Instruction Following—1139

Long Context Not comparable

Qwen3-1.7B: —, Yi-1.5-34B: 34.6 (#248)

Long Context benchmarks
BenchmarkQwen3-1.7BYi-1.5-34B
LMArena Longer Query—1143

Writing & Preference Not comparable

Qwen3-1.7B: —, Yi-1.5-34B: 37.4 (#257)

Writing & Preference benchmarks
BenchmarkQwen3-1.7BYi-1.5-34B
LMArena Text—1173
LMArena Creative Writing—1135
LMArena Multi-Turn—1153

Frequently asked questions

Is Qwen3-1.7B better than Yi-1.5-34B?

Yi-1.5-34B is the stronger model overall, scoring 30.6 to 26.6 on the Noometry Index.

How many benchmarks do Qwen3-1.7B and Yi-1.5-34B share?

1 benchmark has published results for both models. Qwen3-1.7B has 4 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper