Prime Minister Lee Hsien Loong said he was concerned over what the National Heritage Board had agreed to in the Deed of Gift.