New Housing Minister Phil Twyford says affordable housing is top priority.