Noometry

Model comparison

Gemini Advanced 0514 vs Qwen3.5 397B-A17B

Qwen3.5 397B-A17B is the stronger model overall, scoring 45.7 to 37.1 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini Advanced 0514 Google

37.1

Rank #195 Confirmed

Qwen3.5 397B-A17B Alibaba (Qwen)

45.7

Rank #60 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 0 categories and Qwen3.5 397B-A17B in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.5 397B-A17B leads 53.3 to 32.7.
  • Qwen3.5 397B-A17B has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514Qwen3.5 397B-A17B
ProviderGoogleAlibaba (Qwen)
Noometry Index37.145.7
Released—2026-02-01
WeightsProprietaryOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.60
Output $ / M tokens—$3.60
Results tracked1736

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 397B-A17B leads

Gemini Advanced 0514: 36.0 (#202), Qwen3.5 397B-A17B: 41.7 (#108)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
LMArena Coding12551464
LMArena WebDev—1400

Agentic & Tool Use Not comparable

Gemini Advanced 0514: —, Qwen3.5 397B-A17B: 33.2 (#51)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
APEX-Agents—24.9%
τ²-bench Airline—81.5%
τ²-bench Banking—9.8%
τ²-bench Retail—84.4%
τ²-bench Telecom—97.8%

Reasoning Qwen3.5 397B-A17B leads

Gemini Advanced 0514: 23.6 (#163), Qwen3.5 397B-A17B: 33.6 (#62)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
LMArena Hard Prompts12481448
Kagi LLM Benchmark—73.7%
NYT Connections (extended)—58.9%
Chess Puzzles—13%
Thematic Generalization—65.1%
Mystery Game Puzzles—18%
DTBench—87.5%
LMCA—37.9%
Epoch Capabilities Index—146.64

Math Qwen3.5 397B-A17B leads

Gemini Advanced 0514: 32.9 (#181), Qwen3.5 397B-A17B: 44.9 (#64)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
LMArena Math12721455
FrontierMath (Tiers 1-3)—31.2%
OTIS Mock AIME 2024-2025—88.9%

Knowledge Qwen3.5 397B-A17B leads

Gemini Advanced 0514: 32.7 (#201), Qwen3.5 397B-A17B: 53.3 (#53)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
LMArena Expert12151461
GPQA Diamond—86.4%

Multimodal Not comparable

Gemini Advanced 0514: —, Qwen3.5 397B-A17B: 40.0 (#42)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
LMArena Vision—1262

Multilingual Qwen3.5 397B-A17B leads

Gemini Advanced 0514: 42.8 (#187), Qwen3.5 397B-A17B: 54.0 (#56)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
LMArena Non-English12741431
LMArena Chinese12741501
LMArena French13061461
LMArena German12751447
LMArena Japanese12421427
LMArena Korean12321382
LMArena Russian12831429
LMArena Spanish12421443

Instruction Following Qwen3.5 397B-A17B leads

Gemini Advanced 0514: 66.2 (#206), Qwen3.5 397B-A17B: 75.2 (#73)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
LMArena Instruction Following12541424

Long Context Qwen3.5 397B-A17B leads

Gemini Advanced 0514: 38.0 (#202), Qwen3.5 397B-A17B: 44.1 (#71)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
LMArena Longer Query12541442

Writing & Preference Qwen3.5 397B-A17B leads

Gemini Advanced 0514: 48.8 (#195), Qwen3.5 397B-A17B: 62.5 (#74)

BenchmarkGemini Advanced 0514Qwen3.5 397B-A17B
LMArena Text12791438
LMArena Creative Writing12841401
LMArena Multi-Turn12691447
EQ-Bench Creative Writing—1478

Frequently asked questions

Is Gemini Advanced 0514 better than Qwen3.5 397B-A17B?

Qwen3.5 397B-A17B is the stronger model overall, scoring 45.7 to 37.1 on the Noometry Index.

Is Gemini Advanced 0514 or Qwen3.5 397B-A17B better for coding?

Qwen3.5 397B-A17B scores higher on coding benchmarks: 41.7 versus 36.0 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Qwen3.5 397B-A17B share?

17 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Qwen3.5 397B-A17B has 36.

Related comparisons

Go deeper