Of 93 applications for registration referred to the FMA, just 19 were approved.
Three financial service providers have taken legal action against the FMA over their removal.
Now the regulator says it will target Kiwi directors who may be helping companies misuse the register.
Registered companies must have a New Zealand director but the regulator is worried some directors may not be providing a legitimate service.
Liam Mason, director of regulation at the FMA said: "In our experience, some local directors of businesses on the FSPR provide at most an administrative service with little or no real governance role in the company."
The FMA's report sets out its expectations for those directors and scenarios where it would take action against them.
Mason said it would use its full range of enforcement tools against any directors who registered under false pretences or were in breach of the regulations.
It has also published online information for consumers in Chinese, Malay and Arabic reflecting the main regions or areas where the FMA has received the largest number of complaints.
Since 2014 it has received 1080 complaints against 296 businesses or individuals on the register.