Noometry

Model comparison

Gemini 1.5 Flash 8B vs Qwen3 Max

Qwen3 Max is the stronger model overall, scoring 43.7 to 29.9 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Qwen3 Max Alibaba (Qwen)

43.7

Rank #87 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Qwen3 Max in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3 Max leads 48.1 to 16.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 73.3% for Qwen3 Max.

Side by side

Gemini 1.5 Flash 8BQwen3 Max
ProviderGoogleAlibaba (Qwen)
Noometry Index29.943.7
Released2024-10-032025-09-23
WeightsProprietaryProprietary
Context window—262K
Max output—66K
Input $ / M tokens—$1.20
Output $ / M tokens—$6
Results tracked2133

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 Max leads

Gemini 1.5 Flash 8B: 35.5 (#225), Qwen3 Max: 43.0 (#93)

BenchmarkGemini 1.5 Flash 8BQwen3 Max
LMArena Coding12181456
ALE-Bench—370.45

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Qwen3 Max: —

BenchmarkGemini 1.5 Flash 8BQwen3 Max
Vending-Bench 2—71.56

Reasoning Qwen3 Max leads

Gemini 1.5 Flash 8B: 20.0 (#244), Qwen3 Max: 22.6 (#190)

BenchmarkGemini 1.5 Flash 8BQwen3 Max
LMArena Hard Prompts12091448
DTBench50%82.1%
Kagi LLM Benchmark—72.5%
NYT Connections (extended)—30.1%
Chess Puzzles—4%
Mystery Game Puzzles—5%
LMCA—28.3%
Epoch Capabilities Index—142.38

Math Qwen3 Max leads

Gemini 1.5 Flash 8B: 14.2 (#302), Qwen3 Max: 38.7 (#131)

BenchmarkGemini 1.5 Flash 8BQwen3 Max
OTIS Mock AIME 2024-20254.6%73.3%
LMArena Math12071446
FrontierMath (Tiers 1-3)—18.9%
MATH Level 5—97.1%

Knowledge Qwen3 Max leads

Gemini 1.5 Flash 8B: 16.0 (#289), Qwen3 Max: 48.1 (#78)

BenchmarkGemini 1.5 Flash 8BQwen3 Max
GPQA Diamond33%72.6%
LMArena Expert11851455
SimpleQA Verified—48.7%

Multimodal Not comparable

Gemini 1.5 Flash 8B: 28.2 (#115), Qwen3 Max: —

BenchmarkGemini 1.5 Flash 8BQwen3 Max
LMArena Vision1044—

Multilingual Qwen3 Max leads

Gemini 1.5 Flash 8B: 38.5 (#229), Qwen3 Max: 53.7 (#62)

BenchmarkGemini 1.5 Flash 8BQwen3 Max
LMArena Non-English12151429
LMArena Chinese12311478
LMArena French12341449
LMArena German12061463
LMArena Japanese11501397
LMArena Korean11401399
LMArena Russian12361428
LMArena Spanish12121462

Instruction Following Qwen3 Max leads

Gemini 1.5 Flash 8B: 62.8 (#236), Qwen3 Max: 74.8 (#87)

BenchmarkGemini 1.5 Flash 8BQwen3 Max
LMArena Instruction Following11991419

Long Context Qwen3 Max leads

Gemini 1.5 Flash 8B: 37.0 (#225), Qwen3 Max: 41.6 (#134)

BenchmarkGemini 1.5 Flash 8BQwen3 Max
LMArena Longer Query12191438
Fiction.LiveBench—66.7%
CL-bench—14.5%

Writing & Preference Qwen3 Max leads

Gemini 1.5 Flash 8B: 42.8 (#232), Qwen3 Max: 62.4 (#76)

BenchmarkGemini 1.5 Flash 8BQwen3 Max
LMArena Text12261439
LMArena Creative Writing12181402
LMArena Multi-Turn11851446

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Qwen3 Max?

Qwen3 Max is the stronger model overall, scoring 43.7 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Qwen3 Max better for coding?

Qwen3 Max scores higher on coding benchmarks: 43.0 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Qwen3 Max share?

20 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Qwen3 Max has 33.

Related comparisons

Go deeper