In the 19th century the building was home to a radical school run by the Hill family, which included Rowland Hill, also famous as founder of the Uniform Penny Post system. During World War II it was used as a clinic and nursery for the people of Tottenham.
It is now a local museum containing Haringey's archives and an important collection of early photography. There is also a small exhibition about Rowland Hill and postal history.
The current Bruce Castle Park covers 20 acres and was Tottenham's first public park.