Prime Minister Lee Hsien Loong said he had agreed to sell 38 Oxley Road to both his siblings for $1 but there was an "impasse".