A former professional tennis player and college quarterback, and now wealthy real estate developer lives here