Prime Minister John Key has disputed a suggestion that the issue of absentee foreigners buying houses has always been a bottom line for New Zealand First.