Model comparison

Qwen3.5-9B vs Yi-Lightning

Yi-Lightning is the stronger model overall, scoring 37.1 to 33.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen3.5-9B Alibaba (Qwen)

33.8

Rank #236 Confirmed

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • The widest gap is in knowledge, where Qwen3.5-9B leads 46.0 to 35.4.
  • Qwen3.5-9B has downloadable open weights; the other is API-only.

Side by side

Qwen3.5-9B and Yi-Lightning specifications
Qwen3.5-9BYi-Lightning
ProviderAlibaba (Qwen)01.AI
Noometry Index33.837.1
Released2026-02-232024-12-02
WeightsOpenProprietary
Context window262K—
Max output66K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.15—
Results tracked1018

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5-9B leads

Qwen3.5-9B: 35.9 (#217), Yi-Lightning: 27.4 (#320)

Coding benchmarks
BenchmarkQwen3.5-9BYi-Lightning
Aider Polyglot—12.9%
SciCode27.5%—
LMArena Coding—1312

Agentic & Tool Use Not comparable

Qwen3.5-9B: 14.5 (#151), Yi-Lightning: —

Agentic & Tool Use benchmarks
BenchmarkQwen3.5-9BYi-Lightning
Terminal-Bench9.2%—

Reasoning Yi-Lightning leads

Qwen3.5-9B: 23.1 (#182), Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
BenchmarkQwen3.5-9BYi-Lightning
CritPt0.3%—
Chess Puzzles12%—
LMArena Hard Prompts—1302
DTBench71.2%—
LMCA24.5%—
Epoch Capabilities Index139.46—

Math Yi-Lightning leads

Qwen3.5-9B: 34.8 (#192), Yi-Lightning: 36.2 (#172)

Math benchmarks
BenchmarkQwen3.5-9BYi-Lightning
MathArena Final-Answer Competitions48.5%—
OTIS Mock AIME 2024-202561.7%—
LMArena Math—1300

Knowledge Qwen3.5-9B leads

Qwen3.5-9B: 46.0 (#84), Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
BenchmarkQwen3.5-9BYi-Lightning
GPQA Diamond79%—
LMArena Expert—1286

Multilingual Not comparable

Qwen3.5-9B: —, Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
BenchmarkQwen3.5-9BYi-Lightning
LMArena Non-English—1269
LMArena Chinese—1320
LMArena French—1305
LMArena German—1267
LMArena Japanese—1228
LMArena Korean—1192
LMArena Russian—1255
LMArena Spanish—1315

Instruction Following Not comparable

Qwen3.5-9B: —, Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
BenchmarkQwen3.5-9BYi-Lightning
LMArena Instruction Following—1278

Long Context Not comparable

Qwen3.5-9B: —, Yi-Lightning: 39.4 (#181)

Long Context benchmarks
BenchmarkQwen3.5-9BYi-Lightning
LMArena Longer Query—1297

Writing & Preference Not comparable

Qwen3.5-9B: —, Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
BenchmarkQwen3.5-9BYi-Lightning
LMArena Text—1302
LMArena Creative Writing—1280
LMArena Multi-Turn—1311

Frequently asked questions

Is Qwen3.5-9B better than Yi-Lightning?

Yi-Lightning is the stronger model overall, scoring 37.1 to 33.8 on the Noometry Index.

Is Qwen3.5-9B or Yi-Lightning better for coding?

Qwen3.5-9B scores higher on coding benchmarks: 35.9 versus 27.4 in the Noometry coding category.

How many benchmarks do Qwen3.5-9B and Yi-Lightning share?

0 benchmarks have published results for both models. Qwen3.5-9B has 10 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper