Model comparison

Gemini Advanced 0514 vs Qwen3 8B

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 33.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Qwen3 8B Alibaba (Qwen)

33.7

Rank #238 Confirmed

Summary

  • The widest gap is in reasoning, where Gemini Advanced 0514 leads 24.6 to 16.6.
  • Qwen3 8B has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514 and Qwen3 8B specifications
Gemini Advanced 0514Qwen3 8B
ProviderGoogleAlibaba (Qwen)
Noometry Index37.733.7
Released—2025-04
WeightsProprietaryOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.18
Output $ / M tokens—$0.70
Results tracked1711

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.6 (#205), Qwen3 8B: 34.0 (#248)

Coding benchmarks
BenchmarkGemini Advanced 0514Qwen3 8B
SciCode—22.6%
LMArena Coding1255—

Agentic & Tool Use Not comparable

Gemini Advanced 0514: —, Qwen3 8B: 30.2 (#78)

Agentic & Tool Use benchmarks
BenchmarkGemini Advanced 0514Qwen3 8B
Berkeley Function Calling Leaderboard—42.6%

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), Qwen3 8B: 16.6 (#303)

Reasoning benchmarks
BenchmarkGemini Advanced 0514Qwen3 8B
CritPt—0%
Chess Puzzles—5%
LMArena Hard Prompts1248—
DTBench—59.7%
LMCA—8.8%
Epoch Capabilities Index—136.17

Math Too close to call

Gemini Advanced 0514: 35.5 (#181), Qwen3 8B: 34.9 (#191)

Math benchmarks
BenchmarkGemini Advanced 0514Qwen3 8B
OTIS Mock AIME 2024-2025—56.1%
LMArena Math1272—

Knowledge Qwen3 8B leads

Gemini Advanced 0514: 33.3 (#205), Qwen3 8B: 36.1 (#173)

Knowledge benchmarks
BenchmarkGemini Advanced 0514Qwen3 8B
GPQA Diamond—56.8%
Vectara Hallucination Rate—4.8%
LMArena Expert1215—

Multilingual Not comparable

Gemini Advanced 0514: 42.6 (#192), Qwen3 8B: —

Multilingual benchmarks
BenchmarkGemini Advanced 0514Qwen3 8B
LMArena Non-English1274—
LMArena Chinese1274—
LMArena French1307—
LMArena German1275—
LMArena Japanese1242—
LMArena Korean1232—
LMArena Russian1283—
LMArena Spanish1242—

Instruction Following Not comparable

Gemini Advanced 0514: 66.0 (#212), Qwen3 8B: —

Instruction Following benchmarks
BenchmarkGemini Advanced 0514Qwen3 8B
LMArena Instruction Following1253—

Long Context Too close to call

Gemini Advanced 0514: 38.0 (#207), Qwen3 8B: 37.9 (#210)

Long Context benchmarks
BenchmarkGemini Advanced 0514Qwen3 8B
Fiction.LiveBench—62.1%
LMArena Longer Query1253—

Writing & Preference Not comparable

Gemini Advanced 0514: 48.5 (#200), Qwen3 8B: —

Writing & Preference benchmarks
BenchmarkGemini Advanced 0514Qwen3 8B
LMArena Text1279—
LMArena Creative Writing1284—
LMArena Multi-Turn1269—

Frequently asked questions

Is Gemini Advanced 0514 better than Qwen3 8B?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 33.7 on the Noometry Index.

Is Gemini Advanced 0514 or Qwen3 8B better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 34.0 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Qwen3 8B share?

0 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Qwen3 8B has 11.

Related comparisons

Go deeper