It was built by Colonel Philip Kiliaen van Rensselaer for his bride Maria Sanders, granddaughter of Peter Schuyler. During the early 19th century, it was the home of Solomon van Rensselaer, who served in Congress and several local governmental positions. It eventually became the manor house of a large farm. Within several years during the 1820s it was both accommodations for the Marquis de Lafayette on his return visit to the U.S. and the scene of a murder which led to the last public hanging in Albany following a controversial trial. It is reputedly haunted.