Noometry

Model comparison

Gemini 3 Flash Preview vs Qwen3.5 397B-A17B

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 45.7 on the Noometry Index.

Last verified . 32 shared benchmarks.

Gemini 3 Flash Preview Google

52.3

Rank #33 Confirmed

Qwen3.5 397B-A17B Alibaba (Qwen)

45.7

Rank #60 Confirmed

Summary

  • They share 32 benchmarks with published results for both. Gemini 3 Flash Preview scores higher in 10 categories and Qwen3.5 397B-A17B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Flash Preview leads 49.2 to 33.6.
  • The biggest single-benchmark swing is Chess Puzzles: 40% for Gemini 3 Flash Preview and 13% for Qwen3.5 397B-A17B.
  • Gemini 3 Flash Preview is cheaper at $0.50 / $3 per million input/output tokens, against $0.60 / $3.60 for Qwen3.5 397B-A17B.
  • Gemini 3 Flash Preview accepts more context: 1.05M tokens versus 262K.
  • Qwen3.5 397B-A17B has downloadable open weights; the other is API-only.

Side by side

Gemini 3 Flash PreviewQwen3.5 397B-A17B
ProviderGoogleAlibaba (Qwen)
Noometry Index52.345.7
Released2025-12-172026-02-01
WeightsProprietaryOpen
Context window1.05M262K
Max output66K66K
Input $ / M tokens$0.50$0.60
Output $ / M tokens$3$3.60
Results tracked5936

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 51.5 (#35), Qwen3.5 397B-A17B: 41.7 (#108)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
LMArena WebDev14391400
LMArena Coding14601464
SWE-bench Verified75.4%—
SWE-bench Verified (bash only)75.8%—
SWE-bench Multilingual72.7%—
GSO9.8%—
WeirdML61.6%—
ALE-Bench1,367—

Agentic & Tool Use Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 38.6 (#27), Qwen3.5 397B-A17B: 33.2 (#51)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
τ²-bench Airline82.5%81.5%
τ²-bench Banking27.3%9.8%
τ²-bench Retail76.8%84.4%
τ²-bench Telecom91.2%97.8%
Terminal-Bench64.3%—
APEX-Agents—24.9%
DeepResearch Bench49.8%—
BALROG48.1%—
GDP.pdf10%—
LMArena Search1198—
Vending-Bench 23,635—

Reasoning Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 49.2 (#35), Qwen3.5 397B-A17B: 33.6 (#62)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
NYT Connections (extended)83.1%58.9%
Chess Puzzles40%13%
LMArena Hard Prompts14651448
Mystery Game Puzzles26%18%
DTBench89.1%87.5%
LMCA43.1%37.9%
Epoch Capabilities Index151.83146.64
ARC-AGI-233.6%—
SimpleBench61.1%—
Kagi LLM Benchmark—73.7%
ARC-AGI-184.7%—
Thematic Generalization—65.1%
ForecastBench58.5—

Math Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 51.4 (#42), Qwen3.5 397B-A17B: 44.9 (#64)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
FrontierMath (Tiers 1-3)51.2%31.2%
OTIS Mock AIME 2024-202595.6%88.9%
LMArena Math14721455
FrontierMath Tier 417.1%—
MathArena Final-Answer Competitions67.6%—
ProofBench15%—
FrontierMath (Feb 2025 set)35.6%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 58.8 (#30), Qwen3.5 397B-A17B: 53.3 (#53)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
GPQA Diamond89.4%86.4%
LMArena Expert14611461
SimpleQA Verified66.8%—
Vectara Hallucination Rate13.5%—

Multimodal Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 45.3 (#15), Qwen3.5 397B-A17B: 40.0 (#42)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
LMArena Vision12851262
GeoBench88%—
VPCT72.6%—
Blueprint-Bench 20%—
LMArena Document1413—

Multilingual Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 55.9 (#26), Qwen3.5 397B-A17B: 54.0 (#56)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
LMArena Non-English14581431
LMArena Chinese15101501
LMArena French14781461
LMArena German14971447
LMArena Japanese14881427
LMArena Korean14431382
LMArena Russian14801429
LMArena Spanish14701443

Instruction Following Too close to call

Gemini 3 Flash Preview: 75.8 (#52), Qwen3.5 397B-A17B: 75.2 (#73)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
LMArena Instruction Following14371424

Long Context Too close to call

Gemini 3 Flash Preview: 44.4 (#63), Qwen3.5 397B-A17B: 44.1 (#71)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
LMArena Longer Query14521442

Writing & Preference Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 65.6 (#44), Qwen3.5 397B-A17B: 62.5 (#74)

BenchmarkGemini 3 Flash PreviewQwen3.5 397B-A17B
LMArena Text14661438
LMArena Creative Writing14571401
LMArena Multi-Turn14711447
EQ-Bench Creative Writing—1478

Frequently asked questions

Is Gemini 3 Flash Preview better than Qwen3.5 397B-A17B?

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 45.7 on the Noometry Index.

Which is cheaper, Gemini 3 Flash Preview or Qwen3.5 397B-A17B?

Gemini 3 Flash Preview is cheaper. It lists at $0.50 per million input tokens and $3 per million output tokens; Qwen3.5 397B-A17B lists at $0.60 and $3.60.

Is Gemini 3 Flash Preview or Qwen3.5 397B-A17B better for coding?

Gemini 3 Flash Preview scores higher on coding benchmarks: 51.5 versus 41.7 in the Noometry coding category.

Which has the bigger context window?

Gemini 3 Flash Preview does, with 1.05M tokens against 262K.

How many benchmarks do Gemini 3 Flash Preview and Qwen3.5 397B-A17B share?

32 benchmarks have published results for both models. Gemini 3 Flash Preview has 59 scored results on Noometry and Qwen3.5 397B-A17B has 36.

Related comparisons

Go deeper