Model comparison

Qwen Turbo vs StarCoder 2 7B

Qwen Turbo has enough public results to be ranked (#335); StarCoder 2 7B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

StarCoder 2 7B NVIDIA

37.0

Unranked Sparse

Summary

  • StarCoder 2 7B has downloadable open weights; the other is API-only.

Side by side

Qwen Turbo and StarCoder 2 7B specifications
Qwen TurboStarCoder 2 7B
ProviderAlibaba (Qwen)NVIDIA
Noometry Index27.137.0
Released2024-11-012024-02-20
WeightsProprietaryOpen
Context window1M—
Max output16K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.20—
Results tracked37

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen Turbo: —, StarCoder 2 7B: 34.8

Coding benchmarks
BenchmarkQwen TurboStarCoder 2 7B
BigCodeBench Complete—27.7%
HumanEval+—29.9%

Reasoning Not comparable

Qwen Turbo: —, StarCoder 2 7B: —

Reasoning benchmarks
BenchmarkQwen TurboStarCoder 2 7B
Epoch Capabilities Index—93.56
WinoGrande—57.1%

Math Not comparable

Qwen Turbo: 15.3 (#297), StarCoder 2 7B: —

Math benchmarks
BenchmarkQwen TurboStarCoder 2 7B
OTIS Mock AIME 2024-20256.1%—
MATH Level 556.2%—
GSM8K—32.7%

Knowledge Not comparable

Qwen Turbo: 22.2 (#272), StarCoder 2 7B: —

Knowledge benchmarks
BenchmarkQwen TurboStarCoder 2 7B
GPQA Diamond41.8%—
ARC (AI2) Challenge—38.7%
MMLU—38.8%

Frequently asked questions

Is Qwen Turbo better than StarCoder 2 7B?

Qwen Turbo has enough public results to be ranked (#335); StarCoder 2 7B does not yet, so treat this comparison as directional.

How many benchmarks do Qwen Turbo and StarCoder 2 7B share?

0 benchmarks have published results for both models. Qwen Turbo has 3 scored results on Noometry and StarCoder 2 7B has 7.

Related comparisons

Go deeper