Noometry

Model comparison

Claude Sonnet 4.6 vs Yi-Lightning

Claude Sonnet 4.6 is the stronger model overall, scoring 50.3 to 37.1 on the Noometry Index.

Last verified . 17 shared benchmarks.

Claude Sonnet 4.6 Anthropic

50.3

Rank #50 Confirmed

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Claude Sonnet 4.6 scores higher in 8 categories and Yi-Lightning in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Sonnet 4.6 leads 46.1 to 25.9.

Side by side

Claude Sonnet 4.6Yi-Lightning
ProviderAnthropic01.AI
Noometry Index50.337.1
Released2026-02-172024-12-02
WeightsProprietaryProprietary
Context window1M—
Max output128K—
Input $ / M tokens$3—
Output $ / M tokens$15—
Results tracked5718

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 46.3 (#67), Yi-Lightning: 27.4 (#320)

BenchmarkClaude Sonnet 4.6Yi-Lightning
LMArena Coding15041312
SWE-bench Verified75.2%—
DeepSWE29.9%—
FrontierCode24.3%—
Aider Polyglot—12.9%
LMArena WebDev1522—
SciCode46.8%—
WeirdML66.1%—
ALE-Bench1,327—

Agentic & Tool Use Not comparable

Claude Sonnet 4.6: 39.1 (#28), Yi-Lightning: —

BenchmarkClaude Sonnet 4.6Yi-Lightning
Terminal-Bench53.4%—
APEX-Agents43%—
OSWorld 2.09.3%—
DeepResearch Bench54.9%—
OSWorld72.1%—
ExploitBench23.6%—
GBAEval48.8%—
GDP.pdf18%—
LMArena Search1221—
Vending-Bench 27,204—

Reasoning Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 46.1 (#45), Yi-Lightning: 25.9 (#139)

BenchmarkClaude Sonnet 4.6Yi-Lightning
LMArena Hard Prompts14841302
ARC-AGI-260.4%—
NYT Connections (extended)80.9%—
ARC-AGI-186.5%—
CritPt3.1%—
Chess Puzzles13%—
Thematic Generalization76.3%—
Mystery Game Puzzles16%—
DTBench89.9%—
LMCA46.5%—
Epoch Capabilities Index152.24—
ForecastBench62—

Math Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 52.9 (#49), Yi-Lightning: 36.2 (#172)

BenchmarkClaude Sonnet 4.6Yi-Lightning
LMArena Math14621300
OTIS Mock AIME 2024-202585.8%—
ProofBench45%—
FrontierMath (Feb 2025 set)32.4%—
FrontierMath Tier 4 (v1)8.3%—

Knowledge Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 51.7 (#65), Yi-Lightning: 35.4 (#185)

BenchmarkClaude Sonnet 4.6Yi-Lightning
LMArena Expert15001286
GPQA Diamond87.4%—
SimpleQA Verified35.5%—
Vectara Hallucination Rate10.6%—

Multimodal Not comparable

Claude Sonnet 4.6: 38.0 (#68), Yi-Lightning: —

BenchmarkClaude Sonnet 4.6Yi-Lightning
LMArena Vision1283—
Blueprint-Bench 26.7%—
LMArena Document1482—

Multilingual Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 54.4 (#41), Yi-Lightning: 42.2 (#196)

BenchmarkClaude Sonnet 4.6Yi-Lightning
LMArena Non-English14401269
LMArena Chinese14911320
LMArena French14651305
LMArena German14281267
LMArena Japanese14201228
LMArena Korean14111192
LMArena Russian14401255
LMArena Spanish14641315

Instruction Following Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 77.4 (#25), Yi-Lightning: 67.4 (#196)

BenchmarkClaude Sonnet 4.6Yi-Lightning
LMArena Instruction Following14751278

Long Context Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 45.3 (#44), Yi-Lightning: 39.4 (#181)

BenchmarkClaude Sonnet 4.6Yi-Lightning
LMArena Longer Query14791297

Writing & Preference Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 70.2 (#22), Yi-Lightning: 50.2 (#184)

BenchmarkClaude Sonnet 4.6Yi-Lightning
LMArena Text14581302
LMArena Creative Writing14351280
LMArena Multi-Turn14641311
EQ-Bench Creative Writing1810—
EQ-Bench 41207—

Frequently asked questions

Is Claude Sonnet 4.6 better than Yi-Lightning?

Claude Sonnet 4.6 is the stronger model overall, scoring 50.3 to 37.1 on the Noometry Index.

Is Claude Sonnet 4.6 or Yi-Lightning better for coding?

Claude Sonnet 4.6 scores higher on coding benchmarks: 46.3 versus 27.4 in the Noometry coding category.

How many benchmarks do Claude Sonnet 4.6 and Yi-Lightning share?

17 benchmarks have published results for both models. Claude Sonnet 4.6 has 57 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper