All that remains of Waytemore Castle, a motte and bailey construction, is the motte that stands about 15 metres in height. The castle is located in the grounds of Castle Gardens that lie to the east of Bishop's Stortford town centre.
The motte dated from the time of William the Conqueror (11th century) with the keep, now ruins, added in the 12th century.