Model comparison

Gemma 7B vs Qwen3.6 Flash

Qwen3.6 Flash is the stronger model overall, scoring 38.4 to 29.5 on the Noometry Index.

Last verified . 1 shared benchmarks.

Gemma 7B Google

29.5

Rank #295 Confirmed

Qwen3.6 Flash Alibaba (Qwen)

38.4

Rank #176 Confirmed

Summary

  • They share 1 benchmark with published results for both. Gemma 7B scores higher in 0 categories and Qwen3.6 Flash in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.6 Flash leads 42.2 to 26.8.
  • Gemma 7B has downloadable open weights; the other is API-only.

Side by side

Gemma 7B and Qwen3.6 Flash specifications
Gemma 7BQwen3.6 Flash
ProviderGoogleAlibaba (Qwen)
Noometry Index29.538.4
Released2024-02-212026-04-27
WeightsOpenProprietary
Context window—1M
Max output—66K
Input $ / M tokens—$0.19
Output $ / M tokens—$1.13
Results tracked2713

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 7B: 29.9 (#290), Qwen3.6 Flash: —

Coding benchmarks
BenchmarkGemma 7BQwen3.6 Flash
LMArena Coding1048—
ALE-Bench—326.4
HumanEval+28.7%—
MBPP+43.4%—

Reasoning Qwen3.6 Flash leads

Gemma 7B: 19.0 (#247), Qwen3.6 Flash: 28.4 (#90)

Reasoning benchmarks
BenchmarkGemma 7BQwen3.6 Flash
Epoch Capabilities Index111.74143.26
SimpleBench—35.2%
Chess Puzzles—20%
LMArena Hard Prompts1042—
Mystery Game Puzzles—18%
DTBench—77.1%
LMCA—31%
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Qwen3.6 Flash leads

Gemma 7B: 28.7 (#225), Qwen3.6 Flash: 38.0 (#88)

Math benchmarks
BenchmarkGemma 7BQwen3.6 Flash
FrontierMath (Tiers 1-3)—22.5%
OTIS Mock AIME 2024-2025—84.4%
LMArena Math1066—
FrontierMath (Feb 2025 set)—10.3%
FrontierMath Tier 4 (v1)—0%
GSM8K46.4%—

Knowledge Qwen3.6 Flash leads

Gemma 7B: 26.8 (#248), Qwen3.6 Flash: 42.2 (#90)

Knowledge benchmarks
BenchmarkGemma 7BQwen3.6 Flash
GPQA Diamond—83.3%
SimpleQA Verified—15.9%
LMArena Expert1002—
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multilingual Not comparable

Gemma 7B: 25.3 (#282), Qwen3.6 Flash: —

Multilingual benchmarks
BenchmarkGemma 7BQwen3.6 Flash
LMArena Non-English999—
LMArena Chinese1035—
LMArena French1024—
LMArena Russian993—

Instruction Following Not comparable

Gemma 7B: 51.7 (#290), Qwen3.6 Flash: —

Instruction Following benchmarks
BenchmarkGemma 7BQwen3.6 Flash
LMArena Instruction Following1017—

Long Context Not comparable

Gemma 7B: 31.1 (#277), Qwen3.6 Flash: —

Long Context benchmarks
BenchmarkGemma 7BQwen3.6 Flash
LMArena Longer Query1022—

Writing & Preference Not comparable

Gemma 7B: 27.2 (#297), Qwen3.6 Flash: —

Writing & Preference benchmarks
BenchmarkGemma 7BQwen3.6 Flash
LMArena Text1056—
LMArena Creative Writing1024—
LMArena Multi-Turn963—

Frequently asked questions

Is Gemma 7B better than Qwen3.6 Flash?

Qwen3.6 Flash is the stronger model overall, scoring 38.4 to 29.5 on the Noometry Index.

How many benchmarks do Gemma 7B and Qwen3.6 Flash share?

1 benchmark has published results for both models. Gemma 7B has 27 scored results on Noometry and Qwen3.6 Flash has 13.

Related comparisons

Go deeper