Model comparison

Gemma 2 2b IT vs Qwen Turbo

Gemma 2 2b IT is the stronger model overall, scoring 33.1 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 2 2b IT Google

33.1

Rank #248 Confirmed

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Summary

  • The widest gap is in math, where Gemma 2 2b IT leads 32.6 to 15.3.
  • Gemma 2 2b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 2 2b IT and Qwen Turbo specifications
Gemma 2 2b ITQwen Turbo
ProviderGoogleAlibaba (Qwen)
Noometry Index33.127.1
Released—2024-11-01
WeightsOpenProprietary
Context window—1M
Max output—16K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.20
Results tracked173

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 2 2b IT: 32.3 (#273), Qwen Turbo: —

Coding benchmarks
BenchmarkGemma 2 2b ITQwen Turbo
LMArena Coding1112—

Reasoning Not comparable

Gemma 2 2b IT: 21.4 (#224), Qwen Turbo: —

Reasoning benchmarks
BenchmarkGemma 2 2b ITQwen Turbo
LMArena Hard Prompts1113—

Math Gemma 2 2b IT leads

Gemma 2 2b IT: 32.6 (#212), Qwen Turbo: 15.3 (#297)

Math benchmarks
BenchmarkGemma 2 2b ITQwen Turbo
OTIS Mock AIME 2024-2025—6.1%
LMArena Math1135—
MATH Level 5—56.2%

Knowledge Gemma 2 2b IT leads

Gemma 2 2b IT: 29.9 (#231), Qwen Turbo: 22.2 (#272)

Knowledge benchmarks
BenchmarkGemma 2 2b ITQwen Turbo
GPQA Diamond—41.8%
LMArena Expert1096—

Multilingual Not comparable

Gemma 2 2b IT: 32.3 (#257), Qwen Turbo: —

Multilingual benchmarks
BenchmarkGemma 2 2b ITQwen Turbo
LMArena Non-English1121—
LMArena Chinese1132—
LMArena French1157—
LMArena German1114—
LMArena Japanese1083—
LMArena Korean1055—
LMArena Russian1118—
LMArena Spanish1140—

Instruction Following Not comparable

Gemma 2 2b IT: 57.8 (#263), Qwen Turbo: —

Instruction Following benchmarks
BenchmarkGemma 2 2b ITQwen Turbo
LMArena Instruction Following1118—

Long Context Not comparable

Gemma 2 2b IT: 34.3 (#250), Qwen Turbo: —

Long Context benchmarks
BenchmarkGemma 2 2b ITQwen Turbo
LMArena Longer Query1130—

Writing & Preference Not comparable

Gemma 2 2b IT: 36.5 (#263), Qwen Turbo: —

Writing & Preference benchmarks
BenchmarkGemma 2 2b ITQwen Turbo
LMArena Text1156—
LMArena Creative Writing1147—
LMArena Multi-Turn1118—

Frequently asked questions

Is Gemma 2 2b IT better than Qwen Turbo?

Gemma 2 2b IT is the stronger model overall, scoring 33.1 to 27.1 on the Noometry Index.

How many benchmarks do Gemma 2 2b IT and Qwen Turbo share?

0 benchmarks have published results for both models. Gemma 2 2b IT has 17 scored results on Noometry and Qwen Turbo has 3.

Related comparisons

Go deeper