Model comparison

Palm 2 vs Yi-Large

Palm 2 has enough public results to be ranked (#298); Yi-Large does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Palm 2 Google

30.0

Rank #298 Confirmed

Yi-Large 01.AI

38.1

Unranked Sparse

Summary

  • The widest gap is in coding, where Yi-Large leads 36.7 to 29.0.

Side by side

Palm 2 and Yi-Large specifications
Palm 2Yi-Large
ProviderGoogle01.AI
Noometry Index30.038.1
Released—2024-05-13
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked103

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Yi-Large leads

Palm 2: 29.0 (#311), Yi-Large: 36.7 (#203)

Coding benchmarks
BenchmarkPalm 2Yi-Large
BigCodeBench Instruct—37.7%
LMArena Coding994—
BigCodeBench Complete—47.2%

Reasoning Not comparable

Palm 2: 19.1 (#271), Yi-Large: —

Reasoning benchmarks
BenchmarkPalm 2Yi-Large
LMArena Hard Prompts1005—

Math Not comparable

Palm 2: 30.8 (#231), Yi-Large: —

Math benchmarks
BenchmarkPalm 2Yi-Large
LMArena Math1049—

Knowledge Not comparable

Palm 2: —, Yi-Large: —

Knowledge benchmarks
BenchmarkPalm 2Yi-Large
MMLU—79.3%

Multilingual Not comparable

Palm 2: 20.9 (#295), Yi-Large: —

Multilingual benchmarks
BenchmarkPalm 2Yi-Large
LMArena Non-English916—
LMArena Chinese887—

Instruction Following Not comparable

Palm 2: 51.0 (#296), Yi-Large: —

Instruction Following benchmarks
BenchmarkPalm 2Yi-Large
LMArena Instruction Following1010—

Long Context Not comparable

Palm 2: 30.8 (#285), Yi-Large: —

Long Context benchmarks
BenchmarkPalm 2Yi-Large
LMArena Longer Query1010—

Writing & Preference Not comparable

Palm 2: 25.6 (#304), Yi-Large: —

Writing & Preference benchmarks
BenchmarkPalm 2Yi-Large
LMArena Text1027—
LMArena Creative Writing991—
LMArena Multi-Turn994—

Frequently asked questions

Is Palm 2 better than Yi-Large?

Palm 2 has enough public results to be ranked (#298); Yi-Large does not yet, so treat this comparison as directional.

Is Palm 2 or Yi-Large better for coding?

Yi-Large scores higher on coding benchmarks: 36.7 versus 29.0 in the Noometry coding category.

How many benchmarks do Palm 2 and Yi-Large share?

0 benchmarks have published results for both models. Palm 2 has 10 scored results on Noometry and Yi-Large has 3.

Related comparisons

Go deeper