He accumulated more than 150 convictions, many involving dishonesty.
As an inmate, he development a reputation as a "prison lawyer", as he took court action on behalf of himself and other prisoners.
The Department of Corrections said it applied to have Taylor recalled yesterday, "on the grounds that he posed an undue risk to the safety of the community".
"An interim recall was granted by the New Zealand Parole Board and the man is now in custody.
"The New Zealand Parole Board will determine whether a final recall is granted, which would mean this person remains in prison," a spokesperson said.
Corrections said when offender granted parole has to comply with any conditions implied by the board.
"The person's compliance with their conditions is monitored by Community Corrections," the spokesperson said.
"As this matter is now before the New Zealand Parole Board, we are not able to comment further."
- RNZ