A Norman castle was built about 1075 by and apparently demolished in 1484. The site stood derelict until the late 20th century when it was built over and now includes a bus station and a modern housing development.
A small part of the curtain wall survives at the junction of Castle Dyke and Bath Row. From the doorway within it Hustings were held until around 1971, the candidates speaking from a position above the crowd.