Model comparison

Amazon Nova Lite vs Qwen-7B

Amazon Nova Lite has enough public results to be ranked (#262); Qwen-7B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Amazon Nova Lite Amazon

31.4

Rank #262 Confirmed

Summary

  • They share 1 benchmark with published results for both.
  • Qwen-7B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Lite and Qwen-7B specifications
Amazon Nova LiteQwen-7B
ProviderAmazonAlibaba (Qwen)
Noometry Index31.4—
Released2024-12-032023-09-28
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.24—
Results tracked348

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Lite: 32.0 (#266), Qwen-7B: —

Coding benchmarks
BenchmarkAmazon Nova LiteQwen-7B
LiveBench Coding27.5%—
LMArena Coding1239—
ALE-Bench236.25—

Reasoning Not comparable

Amazon Nova Lite: 18.5 (#257), Qwen-7B: —

Reasoning benchmarks
BenchmarkAmazon Nova LiteQwen-7B
LiveBench Reasoning36.7%—
LMArena Hard Prompts1220—
LiveBench Data Analysis37.2%—
BIG-Bench Hard—45%
Epoch Capabilities Index—106.47
LAMBADA—67.9%
LiveBench36.4%—
PIQA—77.9%

Math Not comparable

Amazon Nova Lite: 25.8 (#243), Qwen-7B: —

Math benchmarks
BenchmarkAmazon Nova LiteQwen-7B
Omni-MATH23.3%—
LiveBench Math36.7%—
LMArena Math1227—
GSM8K—51.7%

Knowledge Not comparable

Amazon Nova Lite: 26.0 (#254), Qwen-7B: —

Knowledge benchmarks
BenchmarkAmazon Nova LiteQwen-7B
MMLU77%45%
Humanity's Last Exam3.6%—
MMLU-Pro60%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)39.7%—
LMArena Expert1201—
ARC (AI2) Challenge—75.3%
BoolQ—76.4%

Multimodal Not comparable

Amazon Nova Lite: 25.0 (#118), Qwen-7B: —

Multimodal benchmarks
BenchmarkAmazon Nova LiteQwen-7B
LMArena Vision990—

Multilingual Not comparable

Amazon Nova Lite: 38.2 (#227), Qwen-7B: —

Multilingual benchmarks
BenchmarkAmazon Nova LiteQwen-7B
LMArena Non-English1208—
LMArena Chinese1225—
LMArena French1237—
LMArena German1229—
LMArena Japanese1153—
LMArena Korean1153—
LMArena Russian1216—
LMArena Spanish1225—

Instruction Following Not comparable

Amazon Nova Lite: 59.6 (#250), Qwen-7B: —

Instruction Following benchmarks
BenchmarkAmazon Nova LiteQwen-7B
LiveBench Instruction Following54.1%—
IFEval77.6%—
LMArena Instruction Following1205—

Long Context Not comparable

Amazon Nova Lite: 37.4 (#212), Qwen-7B: —

Long Context benchmarks
BenchmarkAmazon Nova LiteQwen-7B
LMArena Longer Query1234—

Writing & Preference Not comparable

Amazon Nova Lite: 42.3 (#232), Qwen-7B: —

Writing & Preference benchmarks
BenchmarkAmazon Nova LiteQwen-7B
LMArena Text1229—
LMArena Creative Writing1197—
WildBench75%—
LMArena Multi-Turn1199—
LiveBench Language25.9%—

Frequently asked questions

Is Amazon Nova Lite better than Qwen-7B?

Amazon Nova Lite has enough public results to be ranked (#262); Qwen-7B does not yet, so treat this comparison as directional.

How many benchmarks do Amazon Nova Lite and Qwen-7B share?

1 benchmark has published results for both models. Amazon Nova Lite has 34 scored results on Noometry and Qwen-7B has 8.

Related comparisons

Go deeper