A few stones are all that remain of the famous Bastille Castle / Prison that stood in the square to the NW (Place Bastille).