Mr Lee Kuan Yew had discuss with the family "all kinds of permutations" on how to go about demolishing the house and redeveloping the site, said Prime Minister Lee Hsien Loong.