Noometry

Model comparison

Gemma 1.1 7b IT vs Qwen Turbo

Gemma 1.1 7b IT is the stronger model overall, scoring 31.3 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Summary

  • The widest gap is in math, where Gemma 1.1 7b IT leads 32.0 to 15.3.
  • Gemma 1.1 7b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 1.1 7b ITQwen Turbo
ProviderGoogleAlibaba (Qwen)
Noometry Index31.327.1
Released—2024-11-01
WeightsOpenProprietary
Context window—1M
Max output—16K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.20
Results tracked193

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 1.1 7b IT: 31.5 (#284), Qwen Turbo: —

BenchmarkGemma 1.1 7b ITQwen Turbo
LMArena Coding1084—
HumanEval+35.4%—
MBPP+45%—

Reasoning Not comparable

Gemma 1.1 7b IT: 20.5 (#238), Qwen Turbo: —

BenchmarkGemma 1.1 7b ITQwen Turbo
LMArena Hard Prompts1071—

Math Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 32.0 (#220), Qwen Turbo: 15.3 (#297)

BenchmarkGemma 1.1 7b ITQwen Turbo
OTIS Mock AIME 2024-2025—6.1%
LMArena Math1107—
MATH Level 5—56.2%

Knowledge Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 28.3 (#247), Qwen Turbo: 22.2 (#272)

BenchmarkGemma 1.1 7b ITQwen Turbo
GPQA Diamond—41.8%
LMArena Expert1039—

Multilingual Not comparable

Gemma 1.1 7b IT: 28.1 (#273), Qwen Turbo: —

BenchmarkGemma 1.1 7b ITQwen Turbo
LMArena Non-English1052—
LMArena Chinese1061—
LMArena French1065—
LMArena German1054—
LMArena Japanese971—
LMArena Korean988—
LMArena Russian1046—
LMArena Spanish1049—

Instruction Following Not comparable

Gemma 1.1 7b IT: 54.0 (#283), Qwen Turbo: —

BenchmarkGemma 1.1 7b ITQwen Turbo
LMArena Instruction Following1057—

Long Context Not comparable

Gemma 1.1 7b IT: 32.1 (#272), Qwen Turbo: —

BenchmarkGemma 1.1 7b ITQwen Turbo
LMArena Longer Query1056—

Writing & Preference Not comparable

Gemma 1.1 7b IT: 30.4 (#288), Qwen Turbo: —

BenchmarkGemma 1.1 7b ITQwen Turbo
LMArena Text1094—
LMArena Creative Writing1060—
LMArena Multi-Turn1040—

Frequently asked questions

Is Gemma 1.1 7b IT better than Qwen Turbo?

Gemma 1.1 7b IT is the stronger model overall, scoring 31.3 to 27.1 on the Noometry Index.

How many benchmarks do Gemma 1.1 7b IT and Qwen Turbo share?

0 benchmarks have published results for both models. Gemma 1.1 7b IT has 19 scored results on Noometry and Qwen Turbo has 3.

Related comparisons

Go deeper