Model comparison

GPT-5.5 vs Yi-Lightning

GPT-5.5 is the stronger model overall, scoring 63.4 to 37.1 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-5.5 OpenAI

63.4

Rank #9 Confirmed

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GPT-5.5 scores higher in 8 categories and Yi-Lightning in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5.5 leads 72.8 to 25.9.

Side by side

GPT-5.5 and Yi-Lightning specifications
GPT-5.5Yi-Lightning
ProviderOpenAI01.AI
Noometry Index63.437.1
Released2026-04-232024-12-02
WeightsProprietaryProprietary
Context window1.05M—
Max output128K—
Input $ / M tokens$5—
Output $ / M tokens$30—
Results tracked7118

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.5 leads

GPT-5.5: 58.2 (#17), Yi-Lightning: 27.4 (#320)

Coding benchmarks
BenchmarkGPT-5.5Yi-Lightning
LMArena Coding14941312
SWE-bench Verified80.6%—
DeepSWE67%—
FrontierCode43%—
Aider Polyglot—12.9%
LMArena WebDev1513—
SciCode56.1%—
GSO40.2%—
WeirdML84.9%—
MirrorCode10%—
ALE-Bench1,943—

Agentic & Tool Use Not comparable

GPT-5.5: 50.7 (#6), Yi-Lightning: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.5Yi-Lightning
Terminal-Bench84.7%—
APEX-Agents55.1%—
OSWorld 2.013%—
Remote Labor Index6.3%—
τ²-bench Banking44.6%—
DeepResearch Bench54%—
PostTrainBench27.2%—
ExploitBench47.4%—
GBAEval53.2%—
GDP.pdf26%—
LMArena Search1242—
Vending-Bench 27,524—

Reasoning GPT-5.5 leads

GPT-5.5: 72.8 (#11), Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
BenchmarkGPT-5.5Yi-Lightning
LMArena Hard Prompts14891302
ARC-AGI-285%—
SimpleBench69%—
Kagi LLM Benchmark88.8%—
NYT Connections (extended)96.2%—
ARC-AGI-195%—
CritPt27.1%—
Chess Puzzles54%—
EBR-Bench34.3%—
Mystery Game Puzzles56%—
DTBench96%—
LMCA54.3%—
Surface Evolver Bench88.1%—
Bench to the Future 30.14—
Epoch Capabilities Index159.1—
ForecastBench60.6—

Math GPT-5.5 leads

GPT-5.5: 81.7 (#11), Yi-Lightning: 36.2 (#172)

Knowledge GPT-5.5 leads

GPT-5.5: 64.4 (#17), Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
BenchmarkGPT-5.5Yi-Lightning
LMArena Expert15081286
GPQA Diamond94%—
SimpleQA Verified63%—
Vectara Hallucination Rate9.3%—

Multimodal Not comparable

GPT-5.5: 46.9 (#12), Yi-Lightning: —

Multimodal benchmarks
BenchmarkGPT-5.5Yi-Lightning
LMArena Vision1297—
Blueprint-Bench 236.2%—
Furniture Assembly44.2%—
LMArena Document1486—

Multilingual GPT-5.5 leads

GPT-5.5: 56.4 (#20), Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
BenchmarkGPT-5.5Yi-Lightning
LMArena Non-English14671269
LMArena Chinese15331320
LMArena French14861305
LMArena German14801267
LMArena Japanese14981228
LMArena Korean14601192
LMArena Russian14731255
LMArena Spanish14681315

Instruction Following GPT-5.5 leads

GPT-5.5: 77.5 (#18), Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
BenchmarkGPT-5.5Yi-Lightning
LMArena Instruction Following14791278

Long Context GPT-5.5 leads

GPT-5.5: 48.3 (#12), Yi-Lightning: 39.4 (#181)

Long Context benchmarks
BenchmarkGPT-5.5Yi-Lightning
LMArena Longer Query14841297
CL-bench Life22.2%—

Writing & Preference GPT-5.5 leads

GPT-5.5: 72.7 (#13), Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
BenchmarkGPT-5.5Yi-Lightning
LMArena Text14721302
LMArena Creative Writing14551280
LMArena Multi-Turn14761311
EQ-Bench Creative Writing1844—
EQ-Bench 41315—

Frequently asked questions

Is GPT-5.5 better than Yi-Lightning?

GPT-5.5 is the stronger model overall, scoring 63.4 to 37.1 on the Noometry Index.

Is GPT-5.5 or Yi-Lightning better for coding?

GPT-5.5 scores higher on coding benchmarks: 58.2 versus 27.4 in the Noometry coding category.

How many benchmarks do GPT-5.5 and Yi-Lightning share?

17 benchmarks have published results for both models. GPT-5.5 has 71 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper