The castle was originally built in the 13th century by lord van Suilen en Anholt as a simple Donjon. In 1420 during the Hook and Cod wars the castle was completely demolised. In 1525 rebuilding started. In 1752 the castle was modified for the last time.