Noometry

Model comparison

Amazon Nova Lite vs Qwen1.5-14B

Amazon Nova Lite and Qwen1.5-14B score almost the same on the Noometry Index (31.9 vs 32.7), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

Amazon Nova Lite Amazon

31.9

Rank #265 Confirmed

Qwen1.5-14B Alibaba (Qwen)

32.7

Rank #253 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Lite scores higher in 4 categories and Qwen1.5-14B in 4 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Lite leads 42.1 to 33.6.
  • Qwen1.5-14B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova LiteQwen1.5-14B
ProviderAmazonAlibaba (Qwen)
Noometry Index31.932.7
Released2024-12-032024-02-04
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.24—
Results tracked3417

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Lite: 32.5 (#270), Qwen1.5-14B: 33.1 (#263)

BenchmarkAmazon Nova LiteQwen1.5-14B
LMArena Coding12391138
LiveBench Coding27.5%—
ALE-Bench236.25—

Reasoning Qwen1.5-14B leads

Amazon Nova Lite: 19.3 (#260), Qwen1.5-14B: 21.4 (#223)

BenchmarkAmazon Nova LiteQwen1.5-14B
LMArena Hard Prompts12201113
LiveBench Reasoning36.7%—
LiveBench Data Analysis37.2%—
LiveBench36.4%—

Math Qwen1.5-14B leads

Amazon Nova Lite: 27.8 (#247), Qwen1.5-14B: 32.4 (#215)

BenchmarkAmazon Nova LiteQwen1.5-14B
LMArena Math12271125
Omni-MATH23.3%—
LiveBench Math36.7%—

Knowledge Qwen1.5-14B leads

Amazon Nova Lite: 26.3 (#259), Qwen1.5-14B: 29.8 (#232)

BenchmarkAmazon Nova LiteQwen1.5-14B
LMArena Expert12011094
MMLU77%68.6%
Humanity's Last Exam3.6%—
MMLU-Pro60%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)39.7%—

Multimodal Not comparable

Amazon Nova Lite: 25.5 (#123), Qwen1.5-14B: —

BenchmarkAmazon Nova LiteQwen1.5-14B
LMArena Vision990—

Multilingual Amazon Nova Lite leads

Amazon Nova Lite: 38.0 (#232), Qwen1.5-14B: 30.7 (#262)

BenchmarkAmazon Nova LiteQwen1.5-14B
LMArena Non-English12081095
LMArena Chinese12251147
LMArena French12371116
LMArena German12291043
LMArena Japanese11531019
LMArena Russian12161046
LMArena Spanish12261085
LMArena Korean1153—

Instruction Following Amazon Nova Lite leads

Amazon Nova Lite: 59.3 (#255), Qwen1.5-14B: 56.8 (#271)

BenchmarkAmazon Nova LiteQwen1.5-14B
LMArena Instruction Following12051102
LiveBench Instruction Following54.1%—
IFEval77.6%—

Long Context Amazon Nova Lite leads

Amazon Nova Lite: 37.4 (#217), Qwen1.5-14B: 33.7 (#257)

BenchmarkAmazon Nova LiteQwen1.5-14B
LMArena Longer Query12341113

Writing & Preference Amazon Nova Lite leads

Amazon Nova Lite: 42.1 (#237), Qwen1.5-14B: 33.6 (#276)

BenchmarkAmazon Nova LiteQwen1.5-14B
LMArena Text12291128
LMArena Creative Writing11971091
LMArena Multi-Turn11991110
WildBench75%—
LiveBench Language25.9%—

Frequently asked questions

Is Amazon Nova Lite better than Qwen1.5-14B?

Amazon Nova Lite and Qwen1.5-14B score almost the same on the Noometry Index (31.9 vs 32.7), so choose on price, context window or the category you care about most.

Is Amazon Nova Lite or Qwen1.5-14B better for coding?

They score almost the same on coding (32.5 vs 33.1); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Lite and Qwen1.5-14B share?

17 benchmarks have published results for both models. Amazon Nova Lite has 34 scored results on Noometry and Qwen1.5-14B has 17.

Related comparisons

Go deeper