Its name and distinctive appearance are the result of 19th century mining subsidence. One side of the building is now approximately four feet lower than the other.
It stands in an isolated location close to Himley just off the B4176 road between Dudley and Telford, approximately three miles from the nearest town centres of Sedgley and Dudley. Although the entrance to the road leading to it lies within the West Midlands, The Crooked House itself is located just within the South Staffordshire boundary.
The building's leaning walls give rise to some optical illusions as with a gravity hill. These include glasses slowly sliding across 'level' tables and a marble appearing to roll uphill.