Model comparison

Gemini Advanced 0514 vs Qwen1.5 4b Chat

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 28.8 on the Noometry Index.

Last verified . 13 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Qwen1.5 4b Chat Alibaba (Qwen)

28.8

Rank #322 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 8 categories and Qwen1.5 4b Chat in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini Advanced 0514 leads 48.5 to 23.8.
  • Qwen1.5 4b Chat has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514 and Qwen1.5 4b Chat specifications
Gemini Advanced 0514Qwen1.5 4b Chat
ProviderGoogleAlibaba (Qwen)
Noometry Index37.728.8
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1713

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.6 (#205), Qwen1.5 4b Chat: 29.1 (#308)

Coding benchmarks
BenchmarkGemini Advanced 0514Qwen1.5 4b Chat
LMArena Coding1255999

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), Qwen1.5 4b Chat: 18.5 (#279)

Reasoning benchmarks
BenchmarkGemini Advanced 0514Qwen1.5 4b Chat
LMArena Hard Prompts1248976

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), Qwen1.5 4b Chat: 30.4 (#234)

Math benchmarks
BenchmarkGemini Advanced 0514Qwen1.5 4b Chat
LMArena Math12721026

Knowledge Gemini Advanced 0514 leads

Gemini Advanced 0514: 33.3 (#205), Qwen1.5 4b Chat: 26.7 (#255)

Knowledge benchmarks
BenchmarkGemini Advanced 0514Qwen1.5 4b Chat
LMArena Expert1215980

Multilingual Gemini Advanced 0514 leads

Gemini Advanced 0514: 42.6 (#192), Qwen1.5 4b Chat: 24.1 (#290)

Multilingual benchmarks
BenchmarkGemini Advanced 0514Qwen1.5 4b Chat
LMArena Non-English1274979
LMArena Chinese12741024
LMArena German1275902
LMArena Russian1283952
LMArena French1307—
LMArena Japanese1242—
LMArena Korean1232—
LMArena Spanish1242—

Instruction Following Gemini Advanced 0514 leads

Gemini Advanced 0514: 66.0 (#212), Qwen1.5 4b Chat: 49.0 (#300)

Instruction Following benchmarks
BenchmarkGemini Advanced 0514Qwen1.5 4b Chat
LMArena Instruction Following1253978

Long Context Gemini Advanced 0514 leads

Gemini Advanced 0514: 38.0 (#207), Qwen1.5 4b Chat: 30.1 (#290)

Long Context benchmarks
BenchmarkGemini Advanced 0514Qwen1.5 4b Chat
LMArena Longer Query1253988

Writing & Preference Gemini Advanced 0514 leads

Gemini Advanced 0514: 48.5 (#200), Qwen1.5 4b Chat: 23.8 (#309)

Writing & Preference benchmarks
BenchmarkGemini Advanced 0514Qwen1.5 4b Chat
LMArena Text1279997
LMArena Creative Writing1284969
LMArena Multi-Turn1269977

Frequently asked questions

Is Gemini Advanced 0514 better than Qwen1.5 4b Chat?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 28.8 on the Noometry Index.

Is Gemini Advanced 0514 or Qwen1.5 4b Chat better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 29.1 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Qwen1.5 4b Chat share?

13 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Qwen1.5 4b Chat has 13.

Related comparisons

Go deeper