Inland Revenue figures showed that overseas-based borrowers made up 60 per cent of the 85,000 borrowers in default in March, despite only making up 15 per cent of the borrowing population.
The border arrest policy was already used on people who defaulted on child support payments.
Within four days of the Budget announcement - which also raised the required rate of payment and introduced new tools to track overseas borrowers more easily - around 350 ex-students had contacted Inland Revenue, some to restart payments.
But student unions were concerned that if measures became too punitive it would discourage graduates from returning home or from even taking up study.
Labour tertiary education spokeswoman Megan Woods said she was not surprised by the poll result because people's first reaction was that if students borrowed money, they should pay it back. But she stressed it was the effectiveness of the policy, not its popularity, which should be scrutinised.
"You do need to think about a bit of carrot with the stick," she said.
The New Zealand Students Association has criticised using a policy of fear rather than making the payment system more intuitive, saying that it could drive graduates away.
Mr Joyce released figures yesterday showing enrolment numbers in tertiary institutions had dropped nearly 2 per cent in the past year.
Overall, post-graduate enrolments remained steady with a tiny increase in Masters enrolments and a slight decrease in doctoral enrolments.
