The Count of Eu held the castle for most of the Norman period, but King John ordered that the castle be destroyed to prevent it falling into the hands of the Dauphin Louis. In 1220, Henry III re-fortified the castle.
In 1287 violent storms battered the south coast for many months and the soft sandstone cliffs eventually succumbed to the elements. Large sections of the face fell into the sea along with parts of the castle.
In 1339 and 1377, the town was attacked by the French leaving many burnt buildings which included homes. Throughout the next century erosion was unchecked and gradually more of the castle was lost to the sea. The mid 16th century saw the castle receive another blow as Henry VIII commissioned that all catholic monasteries were to be destroyed and this left the site in decay for many years. After that the site was purchased by the Pelham family and used for farming until the ruins had become so overgrown they were lost from memory.
During World War II, the castle received more damage as Hastings was a target for bombing raids. In 1951 the Hastings Corporation purchased the site and converted it into a tourist attraction.