Alibaba (Qwen), open weights

Qwen-7B

Qwen-7B by Alibaba (Qwen) has 8 published benchmark results on Noometry, not yet enough to be ranked.

Last verified

Specifications

Noometry rank
Unranked
Index score
Not ranked
Evidence
8 results
Released
September 28, 2023
Weights
Open weights
Reasoning
Unknown
Context window
—
Max output
—
Input price
Not listed
Output price
Not listed
Blended price
Not listed
Output speed
Not measured
Value
Not ranked
Knowledge cutoff
Unknown

Sponsored placements are available on pages like this one. Advertise on Noometry

Benchmark results

Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.

Reasoning

Qwen-7B Reasoning benchmark results
BenchmarkScorePositionSettingSourceDate
BIG-Bench Hard45%#20 of 27, top 75%Epoch AI
Epoch Capabilities Index106.83#195 of 213, top 92%Epoch AI2023-09-28
LAMBADA67.9%#9 of 9, top 100%Epoch AI
PIQA77.9%#25 of 27, top 93%Epoch AI

Math

Qwen-7B Math benchmark results
BenchmarkScorePositionSettingSourceDate
GSM8K51.7%#22 of 38, top 58%Epoch AI

Knowledge

Qwen-7B Knowledge benchmark results
BenchmarkScorePositionSettingSourceDate
ARC (AI2) Challenge75.3%#17 of 39, top 44%Epoch AI
BoolQ76.4%#19 of 23, top 83%Epoch AI
MMLU45%#72 of 81, top 89%Epoch AI

Compare Qwen-7B

Other Alibaba (Qwen) models

Frequently asked questions

How good is Qwen-7B?

Qwen-7B by Alibaba (Qwen) has 8 published benchmark results on Noometry, not yet enough to be ranked.

Is Qwen-7B open source?

Yes. Qwen-7B's weights are downloadable; check the license for commercial terms.