Noometry

Model comparison

Gemini 3.1 Flash Lite vs Qwen3-4B

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.4 to 31.5 on the Noometry Index.

Last verified . 4 shared benchmarks.

Gemini 3.1 Flash Lite Google

40.4

Rank #141 Confirmed

Qwen3-4B Alibaba (Qwen)

31.5

Rank #261 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 4 categories and Qwen3-4B in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.1 Flash Lite leads 39.5 to 28.5.
  • The biggest single-benchmark swing is GPQA Diamond: 81.8% for Gemini 3.1 Flash Lite and 52.3% for Qwen3-4B.
  • Qwen3-4B has downloadable open weights; the other is API-only.

Side by side

Gemini 3.1 Flash LiteQwen3-4B
ProviderGoogleAlibaba (Qwen)
Noometry Index40.431.5
Released2026-03-032025-04-29
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.25—
Output $ / M tokens$1.50—
Results tracked386

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 3.1 Flash Lite: 37.5 (#179), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena WebDev1256—
SciCode41.9%—
WeirdML52.2%—
LMArena Coding1400—
ALE-Bench797.73—

Agentic & Tool Use Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 29.9 (#72), Qwen3-4B: 27.3 (#94)

BenchmarkGemini 3.1 Flash LiteQwen3-4B
Berkeley Function Calling Leaderboard—35.7%
DeepResearch Bench37.3%—

Reasoning Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 22.3 (#181), Qwen3-4B: 18.5 (#264)

BenchmarkGemini 3.1 Flash LiteQwen3-4B
Chess Puzzles25%4%
Kagi LLM Benchmark67.2%—
NYT Connections (extended)8.2%—
CritPt1.1%—
EnigmaEval3%—
Thematic Generalization63.3%—
LMArena Hard Prompts1407—
DTBench76.8%—
LMCA35%—
Epoch Capabilities Index144.45—
ForecastBench54.4—

Math Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 39.5 (#82), Qwen3-4B: 28.5 (#228)

BenchmarkGemini 3.1 Flash LiteQwen3-4B
OTIS Mock AIME 2024-202580%52.2%
FrontierMath (Tiers 1-3)27.7%—
MathArena Final-Answer Competitions—38.5%
LMArena Math1427—

Knowledge Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 41.7 (#95), Qwen3-4B: 33.0 (#198)

BenchmarkGemini 3.1 Flash LiteQwen3-4B
GPQA Diamond81.8%52.3%
Vectara Hallucination Rate8.2%5.7%
Humanity's Last Exam8.6%—
LMArena Expert1397—

Multimodal Not comparable

Gemini 3.1 Flash Lite: 38.7 (#57), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Vision1240—

Multilingual Not comparable

Gemini 3.1 Flash Lite: 52.5 (#82), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Non-English1410—
LMArena Chinese1461—
LMArena French1423—
LMArena German1429—
LMArena Japanese1411—
LMArena Korean1393—
LMArena Russian1420—
LMArena Spanish1420—

Instruction Following Not comparable

Gemini 3.1 Flash Lite: 72.9 (#126), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Instruction Following1376—

Long Context Not comparable

Gemini 3.1 Flash Lite: 42.5 (#117), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Longer Query1394—

Writing & Preference Not comparable

Gemini 3.1 Flash Lite: 61.0 (#90), Qwen3-4B: —

BenchmarkGemini 3.1 Flash LiteQwen3-4B
LMArena Text1416—
LMArena Creative Writing1401—
LMArena Multi-Turn1417—

Frequently asked questions

Is Gemini 3.1 Flash Lite better than Qwen3-4B?

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.4 to 31.5 on the Noometry Index.

How many benchmarks do Gemini 3.1 Flash Lite and Qwen3-4B share?

4 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and Qwen3-4B has 6.

Related comparisons

Go deeper