According to one local legend, the castle was abandoned after the infant son of the chieftain who dwelt there at the time, in the charge of a nursemaid, fell from a window and was dashed on the rocks below. As a punishment, the nursemaid was set adrift on the North Atlantic in a small boat.