Model comparison

Palm 2 vs Qwen Plus

Qwen Plus is the stronger model overall, scoring 37.1 to 30.0 on the Noometry Index.

Last verified . 10 shared benchmarks.

Palm 2 Google

30.0

Rank #298 Confirmed

Qwen Plus Alibaba (Qwen)

37.1

Rank #210 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Palm 2 scores higher in 1 category and Qwen Plus in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen Plus leads 52.2 to 25.6.

Side by side

Palm 2 and Qwen Plus specifications
Palm 2Qwen Plus
ProviderGoogleAlibaba (Qwen)
Noometry Index30.037.1
Released—2024-01-25
WeightsProprietaryProprietary
Context window—1M
Max output—33K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.20
Results tracked1020

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen Plus leads

Palm 2: 29.0 (#311), Qwen Plus: 38.9 (#167)

Coding benchmarks
BenchmarkPalm 2Qwen Plus
LMArena Coding9941328

Reasoning Qwen Plus leads

Palm 2: 19.1 (#271), Qwen Plus: 28.4 (#107)

Reasoning benchmarks
BenchmarkPalm 2Qwen Plus
LMArena Hard Prompts10051317
Kagi LLM Benchmark—63.3%
DTBench—81.1%
LMCA—24%

Math Palm 2 leads

Palm 2: 30.8 (#231), Qwen Plus: 23.3 (#271)

Math benchmarks
BenchmarkPalm 2Qwen Plus
LMArena Math10491326
OTIS Mock AIME 2024-2025—17.8%
MATH Level 5—65.3%
FrontierMath (Feb 2025 set)—1.7%

Knowledge Not comparable

Palm 2: —, Qwen Plus: 27.4 (#251)

Knowledge benchmarks
BenchmarkPalm 2Qwen Plus
GPQA Diamond—48.1%
LMArena Expert—1328

Multilingual Qwen Plus leads

Palm 2: 20.9 (#295), Qwen Plus: 45.1 (#175)

Multilingual benchmarks
BenchmarkPalm 2Qwen Plus
LMArena Non-English9161310
LMArena Chinese8871347
LMArena Japanese—1251
LMArena Russian—1323

Instruction Following Qwen Plus leads

Palm 2: 51.0 (#296), Qwen Plus: 68.8 (#181)

Instruction Following benchmarks
BenchmarkPalm 2Qwen Plus
LMArena Instruction Following10101303

Long Context Qwen Plus leads

Palm 2: 30.8 (#285), Qwen Plus: 40.3 (#158)

Long Context benchmarks
BenchmarkPalm 2Qwen Plus
LMArena Longer Query10101324

Writing & Preference Qwen Plus leads

Palm 2: 25.6 (#304), Qwen Plus: 52.2 (#176)

Writing & Preference benchmarks
BenchmarkPalm 2Qwen Plus
LMArena Text10271326
LMArena Creative Writing9911293
LMArena Multi-Turn9941336

Frequently asked questions

Is Palm 2 better than Qwen Plus?

Qwen Plus is the stronger model overall, scoring 37.1 to 30.0 on the Noometry Index.

Is Palm 2 or Qwen Plus better for coding?

Qwen Plus scores higher on coding benchmarks: 38.9 versus 29.0 in the Noometry coding category.

How many benchmarks do Palm 2 and Qwen Plus share?

10 benchmarks have published results for both models. Palm 2 has 10 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper