Model comparison

Qwen3-1.7B vs Yi-Lightning

Yi-Lightning is the stronger model overall, scoring 37.1 to 26.6 on the Noometry Index.

Last verified October 10, 2026. 0 shared benchmarks.

Qwen3-1.7B

Alibaba (Qwen)

26.6

Rank #336 Reported

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

The widest gap is in math, where Yi-Lightning leads 36.2 to 16.3.
Qwen3-1.7B has downloadable open weights; the other is API-only.

Side by side

Qwen3-1.7B and Yi-Lightning specifications
	Qwen3-1.7B	Yi-Lightning
Provider	Alibaba (Qwen)	01.AI
Noometry Index	26.6	37.1
Released	2025-04-29	2024-12-02
Weights	Open	Proprietary
Context window	—	—
Max output	—	—
Input $ / M tokens	—	—
Output $ / M tokens	—	—
Results tracked	4	18

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen3-1.7B: —, Yi-Lightning: 27.4 (#320)

Coding benchmarks
Benchmark	Qwen3-1.7B	Yi-Lightning
Aider Polyglot	—	12.9%
LMArena Coding	—	1312

Agentic & Tool Use Not comparable

Qwen3-1.7B: 24.7 (#115), Yi-Lightning: —

Agentic & Tool Use benchmarks
Benchmark	Qwen3-1.7B	Yi-Lightning
Berkeley Function Calling Leaderboard	28.4%	—

Reasoning Yi-Lightning leads

Qwen3-1.7B: 19.2 (#267), Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
Benchmark	Qwen3-1.7B	Yi-Lightning
Chess Puzzles	0%	—
LMArena Hard Prompts	—	1302

Math Yi-Lightning leads

Qwen3-1.7B: 16.3 (#294), Yi-Lightning: 36.2 (#172)

Math benchmarks
Benchmark	Qwen3-1.7B	Yi-Lightning
OTIS Mock AIME 2024-2025	8.1%	—
LMArena Math	—	1300

Knowledge Yi-Lightning leads

Qwen3-1.7B: 19.6 (#278), Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
Benchmark	Qwen3-1.7B	Yi-Lightning
GPQA Diamond	38%	—
LMArena Expert	—	1286

Multilingual Not comparable

Qwen3-1.7B: —, Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
Benchmark	Qwen3-1.7B	Yi-Lightning
LMArena Non-English	—	1269
LMArena Chinese	—	1320
LMArena French	—	1305
LMArena German	—	1267
LMArena Japanese	—	1228
LMArena Korean	—	1192
LMArena Russian	—	1255
LMArena Spanish	—	1315

Instruction Following Not comparable

Qwen3-1.7B: —, Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
Benchmark	Qwen3-1.7B	Yi-Lightning
LMArena Instruction Following	—	1278

Long Context Not comparable

Qwen3-1.7B: —, Yi-Lightning: 39.4 (#181)

Long Context benchmarks
Benchmark	Qwen3-1.7B	Yi-Lightning
LMArena Longer Query	—	1297

Writing & Preference Not comparable

Qwen3-1.7B: —, Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
Benchmark	Qwen3-1.7B	Yi-Lightning
LMArena Text	—	1302
LMArena Creative Writing	—	1280
LMArena Multi-Turn	—	1311

Frequently asked questions

Is Qwen3-1.7B better than Yi-Lightning?