Model comparison

Gemini 1.0 Pro vs Qwen Turbo

Gemini 1.0 Pro and Qwen Turbo score almost the same on the Noometry Index (27.3 vs 27.1), so choose on price, context window or the category you care about most.

Last verified . 3 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Summary

  • They share 3 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Qwen Turbo in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen Turbo leads 22.2 to 15.6.
  • The biggest single-benchmark swing is MATH Level 5: 11.2% for Gemini 1.0 Pro and 56.2% for Qwen Turbo.

Side by side

Gemini 1.0 Pro and Qwen Turbo specifications
Gemini 1.0 ProQwen Turbo
ProviderGoogleAlibaba (Qwen)
Noometry Index27.327.1
Released2023-12-132024-11-01
WeightsProprietaryProprietary
Context window—1M
Max output—16K
Input $ / M tokens—$0.05
Output $ / M tokens—$0.20
Results tracked243

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 1.0 Pro: 32.2 (#275), Qwen Turbo: —

Coding benchmarks
BenchmarkGemini 1.0 ProQwen Turbo
LMArena Coding1108—
HumanEval+55.5%—
MBPP+61.4%—

Reasoning Not comparable

Gemini 1.0 Pro: 17.1 (#296), Qwen Turbo: —

Reasoning benchmarks
BenchmarkGemini 1.0 ProQwen Turbo
LMArena Hard Prompts1109—
DTBench45.9%—
Epoch Capabilities Index117.04—

Math Qwen Turbo leads

Gemini 1.0 Pro: 9.3 (#321), Qwen Turbo: 15.3 (#297)

Math benchmarks
BenchmarkGemini 1.0 ProQwen Turbo
OTIS Mock AIME 2024-20251.1%6.1%
MATH Level 511.2%56.2%
LMArena Math1132—

Knowledge Qwen Turbo leads

Gemini 1.0 Pro: 15.6 (#291), Qwen Turbo: 22.2 (#272)

Knowledge benchmarks
BenchmarkGemini 1.0 ProQwen Turbo
GPQA Diamond34%41.8%
LMArena Expert1059—
MMLU70%—

Multilingual Not comparable

Gemini 1.0 Pro: 33.4 (#252), Qwen Turbo: —

Multilingual benchmarks
BenchmarkGemini 1.0 ProQwen Turbo
LMArena Non-English1138—
LMArena Chinese1124—
LMArena French1145—
LMArena German1125—
LMArena Japanese1023—
LMArena Russian1186—
LMArena Spanish1119—

Instruction Following Not comparable

Gemini 1.0 Pro: 57.6 (#267), Qwen Turbo: —

Instruction Following benchmarks
BenchmarkGemini 1.0 ProQwen Turbo
LMArena Instruction Following1114—

Long Context Not comparable

Gemini 1.0 Pro: 34.3 (#249), Qwen Turbo: —

Long Context benchmarks
BenchmarkGemini 1.0 ProQwen Turbo
LMArena Longer Query1132—

Writing & Preference Not comparable

Gemini 1.0 Pro: 36.0 (#264), Qwen Turbo: —

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProQwen Turbo
LMArena Text1149—
LMArena Creative Writing1131—
LMArena Multi-Turn1139—

Frequently asked questions

Is Gemini 1.0 Pro better than Qwen Turbo?

Gemini 1.0 Pro and Qwen Turbo score almost the same on the Noometry Index (27.3 vs 27.1), so choose on price, context window or the category you care about most.

How many benchmarks do Gemini 1.0 Pro and Qwen Turbo share?

3 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Qwen Turbo has 3.

Related comparisons

Go deeper