Noometry

Model comparison

Gemini 3.1 Flash Lite vs Qwen3.8 27B

Qwen3.8 27B is the stronger model overall, scoring 46.0 to 40.8 on the Noometry Index.

Last verified . 25 shared benchmarks.

Gemini 3.1 Flash Lite Google

40.8

Rank #144 Confirmed

Qwen3.8 27B Alibaba (Qwen)

46.0

Rank #68 Confirmed

Summary

  • They share 25 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 2 categories and Qwen3.8 27B in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen3.8 27B leads 41.0 to 22.9.
  • The biggest single-benchmark swing is NYT Connections (extended): 8.2% for Gemini 3.1 Flash Lite and 54.5% for Qwen3.8 27B.
  • Gemini 3.1 Flash Lite is cheaper at $0.25 / $1.50 per million input/output tokens, against $0.04 / $2.30 for Qwen3.8 27B.
  • Gemini 3.1 Flash Lite accepts more context: 1.05M tokens versus 262K.
  • Qwen3.8 27B has downloadable open weights; the other is API-only.

Side by side

Gemini 3.1 Flash LiteQwen3.8 27B
ProviderGoogleAlibaba (Qwen)
Noometry Index40.846.0
Released2026-03-032026-08-14
WeightsProprietaryOpen
Context window1.05M262K
Max output66K33K
Input $ / M tokens$0.25$0.04
Output $ / M tokens$1.50$2.30
Results tracked3831

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.8 27B leads

Gemini 3.1 Flash Lite: 37.8 (#188), Qwen3.8 27B: 50.5 (#44)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
LMArena WebDev12561593
SciCode41.9%46.6%
LMArena Coding14001482
WeirdML52.2%—
ALE-Bench797.73—

Agentic & Tool Use Qwen3.8 27B leads

Gemini 3.1 Flash Lite: 30.2 (#79), Qwen3.8 27B: 32.9 (#57)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
APEX-Agents—47.5%
DeepResearch Bench37.3%—

Reasoning Qwen3.8 27B leads

Gemini 3.1 Flash Lite: 22.9 (#186), Qwen3.8 27B: 41.0 (#54)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
NYT Connections (extended)8.2%54.5%
CritPt1.1%5.4%
LMArena Hard Prompts14071460
DTBench76.8%88%
LMCA35%41.4%
Epoch Capabilities Index144.47149.38
ARC-AGI-2—42.4%
Kagi LLM Benchmark67.2%—
ARC-AGI-1—87.5%
Chess Puzzles25%—
EnigmaEval3%—
Thematic Generalization63.3%—
Surface Evolver Bench—45%
ForecastBench54.4—

Math Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 40.7 (#90), Qwen3.8 27B: 37.1 (#161)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
LMArena Math14281456
FrontierMath (Tiers 1-3)27.7%—
OTIS Mock AIME 2024-202580%—
ProofBench—16%

Knowledge Too close to call

Gemini 3.1 Flash Lite: 41.9 (#104), Qwen3.8 27B: 41.6 (#109)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
LMArena Expert13981482
GPQA Diamond81.8%—
Humanity's Last Exam8.6%—
Vectara Hallucination Rate8.2%—

Multimodal Qwen3.8 27B leads

Gemini 3.1 Flash Lite: 39.4 (#60), Qwen3.8 27B: 41.3 (#37)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
LMArena Vision12401271

Multilingual Qwen3.8 27B leads

Gemini 3.1 Flash Lite: 52.3 (#86), Qwen3.8 27B: 53.7 (#60)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
LMArena Non-English14111430
LMArena Chinese14611504
LMArena French14241465
LMArena German14291438
LMArena Japanese14131384
LMArena Korean13921393
LMArena Russian14201415
LMArena Spanish14211448

Instruction Following Qwen3.8 27B leads

Gemini 3.1 Flash Lite: 72.7 (#131), Qwen3.8 27B: 75.8 (#53)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
LMArena Instruction Following13771439

Long Context Qwen3.8 27B leads

Gemini 3.1 Flash Lite: 42.5 (#122), Qwen3.8 27B: 44.3 (#70)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
LMArena Longer Query13941450

Writing & Preference Qwen3.8 27B leads

Gemini 3.1 Flash Lite: 60.9 (#94), Qwen3.8 27B: 65.8 (#43)

BenchmarkGemini 3.1 Flash LiteQwen3.8 27B
LMArena Text14161441
LMArena Creative Writing14011384
LMArena Multi-Turn14171441
EQ-Bench Creative Writing—1671

Frequently asked questions

Is Gemini 3.1 Flash Lite better than Qwen3.8 27B?

Qwen3.8 27B is the stronger model overall, scoring 46.0 to 40.8 on the Noometry Index.

Which is cheaper, Gemini 3.1 Flash Lite or Qwen3.8 27B?

Gemini 3.1 Flash Lite is cheaper. It lists at $0.25 per million input tokens and $1.50 per million output tokens; Qwen3.8 27B lists at $0.04 and $2.30.

Is Gemini 3.1 Flash Lite or Qwen3.8 27B better for coding?

Qwen3.8 27B scores higher on coding benchmarks: 50.5 versus 37.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.1 Flash Lite does, with 1.05M tokens against 262K.

How many benchmarks do Gemini 3.1 Flash Lite and Qwen3.8 27B share?

25 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and Qwen3.8 27B has 31.

Related comparisons

Go deeper