The four establishments are the National Institute of Studies, EDENZ Colleges Ltd, Aotearoa Tertiary Institute and the New Zealand School of Business and Government.
The suspension will only impact on new or undecided visa applications.
INZ general manager Peter Elms said the breaches were serious and included students studying for less than the minimum 20 hours a week, misleading or poorly maintained attendance records and fee discrepancies.
"It is concerning that these private training establishments have been operating in a manner that falls well below minimum standards and, in so doing, jeopardising the quality of the education provided to their international students," Mr Elms said.
"The actions of a handful of PTEs can have serious implications for the reputation of New Zealand as a quality education destination.
"We are determined to maintain the integrity of the export education industry and New Zealand's reputation as a quality destination and we owe it to the vast majority of high quality PTEs to take a firm stance on this issue."
NZQA issued compliance notices to all four PTEs.
"The actions of the four PTEs have undermined the integrity of New Zealand's export education industry, which has an enviable reputation and is worth around $2.7 billion a year to the economy," said NZQA's deputy chief executive, Tim Fowler.
"This action sends a strong message to the industry that these sorts of breaches will not be tolerated."