Model comparison

Gemma 7B vs Qwen3.6 Max Preview

Qwen3.6 Max Preview is the stronger model overall, scoring 51.5 to 30.0 on the Noometry Index.

Last verified . 14 shared benchmarks.

Gemma 7B Google

30.0

Rank #299 Confirmed

Qwen3.6 Max Preview Alibaba (Qwen)

51.5

Rank #43 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Gemma 7B scores higher in 0 categories and Qwen3.6 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.6 Max Preview leads 63.8 to 27.1.
  • Gemma 7B has downloadable open weights; the other is API-only.

Side by side

Gemma 7B and Qwen3.6 Max Preview specifications
Gemma 7BQwen3.6 Max Preview
ProviderGoogleAlibaba (Qwen)
Noometry Index30.051.5
Released2024-02-212026-04-20
WeightsOpenProprietary
Context window—262K
Max output—66K
Input $ / M tokens—$1.30
Output $ / M tokens—$7.80
Results tracked2729

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.6 Max Preview leads

Gemma 7B: 30.5 (#294), Qwen3.6 Max Preview: 48.7 (#54)

Coding benchmarks
BenchmarkGemma 7BQwen3.6 Max Preview
LMArena Coding10481471
SWE-bench Verified—76.7%
LMArena WebDev—1482
HumanEval+28.7%—
MBPP+43.4%—

Agentic & Tool Use Not comparable

Gemma 7B: —, Qwen3.6 Max Preview: —

Agentic & Tool Use benchmarks
BenchmarkGemma 7BQwen3.6 Max Preview
Vending-Bench 2—4,254

Reasoning Qwen3.6 Max Preview leads

Gemma 7B: 19.9 (#249), Qwen3.6 Max Preview: 41.7 (#53)

Reasoning benchmarks
BenchmarkGemma 7BQwen3.6 Max Preview
LMArena Hard Prompts10421457
Epoch Capabilities Index111.99149.24
SimpleBench—63%
NYT Connections (extended)—74.1%
Chess Puzzles—20%
Mystery Game Puzzles—19%
DTBench—87.2%
LMCA—42.5%
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Qwen3.6 Max Preview leads

Gemma 7B: 31.2 (#228), Qwen3.6 Max Preview: 54.1 (#46)

Math benchmarks
BenchmarkGemma 7BQwen3.6 Max Preview
LMArena Math10661465
OTIS Mock AIME 2024-2025—91.1%
FrontierMath (Feb 2025 set)—23.1%
FrontierMath Tier 4 (v1)—4.2%
GSM8K46.4%—

Knowledge Qwen3.6 Max Preview leads

Gemma 7B: 27.3 (#252), Qwen3.6 Max Preview: 57.6 (#39)

Knowledge benchmarks
BenchmarkGemma 7BQwen3.6 Max Preview
LMArena Expert10011478
GPQA Diamond—87.4%
SimpleQA Verified—52%
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multilingual Qwen3.6 Max Preview leads

Gemma 7B: 25.1 (#287), Qwen3.6 Max Preview: 54.2 (#48)

Multilingual benchmarks
BenchmarkGemma 7BQwen3.6 Max Preview
LMArena Non-English9991437
LMArena Chinese10351487
LMArena French10251449
LMArena Russian9931445
LMArena Spanish—1454

Instruction Following Qwen3.6 Max Preview leads

Gemma 7B: 51.5 (#295), Qwen3.6 Max Preview: 75.7 (#55)

Instruction Following benchmarks
BenchmarkGemma 7BQwen3.6 Max Preview
LMArena Instruction Following10171438

Long Context Qwen3.6 Max Preview leads

Gemma 7B: 31.1 (#282), Qwen3.6 Max Preview: 44.6 (#61)

Long Context benchmarks
BenchmarkGemma 7BQwen3.6 Max Preview
LMArena Longer Query10221457

Writing & Preference Qwen3.6 Max Preview leads

Gemma 7B: 27.1 (#302), Qwen3.6 Max Preview: 63.8 (#60)

Writing & Preference benchmarks
BenchmarkGemma 7BQwen3.6 Max Preview
LMArena Text10561447
LMArena Creative Writing10241435
LMArena Multi-Turn9631456

Frequently asked questions

Is Gemma 7B better than Qwen3.6 Max Preview?

Qwen3.6 Max Preview is the stronger model overall, scoring 51.5 to 30.0 on the Noometry Index.

Is Gemma 7B or Qwen3.6 Max Preview better for coding?

Qwen3.6 Max Preview scores higher on coding benchmarks: 48.7 versus 30.5 in the Noometry coding category.

How many benchmarks do Gemma 7B and Qwen3.6 Max Preview share?

14 benchmarks have published results for both models. Gemma 7B has 27 scored results on Noometry and Qwen3.6 Max Preview has 29.

Related comparisons

Go deeper