Model comparison

Gemma 7B vs Qwen3.5 122B-A10B

Qwen3.5 122B-A10B is the stronger model overall, scoring 42.1 to 30.0 on the Noometry Index.

Last verified . 13 shared benchmarks.

Gemma 7B Google

30.0

Rank #299 Confirmed

Qwen3.5 122B-A10B Alibaba (Qwen)

42.1

Rank #119 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Gemma 7B scores higher in 0 categories and Qwen3.5 122B-A10B in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 122B-A10B leads 60.0 to 27.1.

Side by side

Gemma 7B and Qwen3.5 122B-A10B specifications
Gemma 7BQwen3.5 122B-A10B
ProviderGoogleAlibaba (Qwen)
Noometry Index30.042.1
Released2024-02-212026-02-23
WeightsOpenOpen
Context window—262K
Max output—66K
Input $ / M tokens—$0.40
Output $ / M tokens—$3.20
Results tracked2727

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 122B-A10B leads

Gemma 7B: 30.5 (#294), Qwen3.5 122B-A10B: 39.1 (#162)

Coding benchmarks
BenchmarkGemma 7BQwen3.5 122B-A10B
LMArena Coding10481436
LMArena WebDev—1360
SciCode—35.6%
HumanEval+28.7%—
MBPP+43.4%—

Reasoning Qwen3.5 122B-A10B leads

Gemma 7B: 19.9 (#249), Qwen3.5 122B-A10B: 27.2 (#123)

Reasoning benchmarks
BenchmarkGemma 7BQwen3.5 122B-A10B
LMArena Hard Prompts10421421
NYT Connections (extended)—51.7%
CritPt—0.9%
Thematic Generalization—51.2%
Mystery Game Puzzles—17%
DTBench—84.3%
LMCA—32.2%
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
Epoch Capabilities Index111.99—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Qwen3.5 122B-A10B leads

Gemma 7B: 31.2 (#228), Qwen3.5 122B-A10B: 39.1 (#112)

Math benchmarks
BenchmarkGemma 7BQwen3.5 122B-A10B
LMArena Math10661432
GSM8K46.4%—

Knowledge Qwen3.5 122B-A10B leads

Gemma 7B: 27.3 (#252), Qwen3.5 122B-A10B: 38.8 (#142)

Knowledge benchmarks
BenchmarkGemma 7BQwen3.5 122B-A10B
LMArena Expert10011432
Vectara Hallucination Rate—11.2%
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multimodal Not comparable

Gemma 7B: —, Qwen3.5 122B-A10B: 39.6 (#57)

Multimodal benchmarks
BenchmarkGemma 7BQwen3.5 122B-A10B
LMArena Vision—1245

Multilingual Qwen3.5 122B-A10B leads

Gemma 7B: 25.1 (#287), Qwen3.5 122B-A10B: 51.6 (#107)

Multilingual benchmarks
BenchmarkGemma 7BQwen3.5 122B-A10B
LMArena Non-English9991400
LMArena Chinese10351462
LMArena French10251442
LMArena Russian9931400
LMArena German—1426
LMArena Japanese—1367
LMArena Korean—1352
LMArena Spanish—1424

Instruction Following Qwen3.5 122B-A10B leads

Gemma 7B: 51.5 (#295), Qwen3.5 122B-A10B: 73.8 (#115)

Instruction Following benchmarks
BenchmarkGemma 7BQwen3.5 122B-A10B
LMArena Instruction Following10171399

Long Context Qwen3.5 122B-A10B leads

Gemma 7B: 31.1 (#282), Qwen3.5 122B-A10B: 43.0 (#109)

Long Context benchmarks
BenchmarkGemma 7BQwen3.5 122B-A10B
LMArena Longer Query10221410

Writing & Preference Qwen3.5 122B-A10B leads

Gemma 7B: 27.1 (#302), Qwen3.5 122B-A10B: 60.0 (#105)

Writing & Preference benchmarks
BenchmarkGemma 7BQwen3.5 122B-A10B
LMArena Text10561417
LMArena Creative Writing10241368
LMArena Multi-Turn9631416

Frequently asked questions

Is Gemma 7B better than Qwen3.5 122B-A10B?

Qwen3.5 122B-A10B is the stronger model overall, scoring 42.1 to 30.0 on the Noometry Index.

Is Gemma 7B or Qwen3.5 122B-A10B better for coding?

Qwen3.5 122B-A10B scores higher on coding benchmarks: 39.1 versus 30.5 in the Noometry coding category.

How many benchmarks do Gemma 7B and Qwen3.5 122B-A10B share?

13 benchmarks have published results for both models. Gemma 7B has 27 scored results on Noometry and Qwen3.5 122B-A10B has 27.

Related comparisons

Go deeper