He has been denied parole twice, with Parole Board conveners stating there wasn't an appropriate address for him to be released to and they had concerns as to whether he would "present an undue risk to the safety of the community" considering Tiumalu chose to "stand by" and not stop his wife from sending threatening text messages to Ms Fenton before she took her own life.
He also never got help for the girl when he knew she was suicidal.
Tiumalu is due to appear before the Parole Board again in late May.
Tiumalu appealed the deportation order he was subject to, but was declined an exemption to stay in New Zealand.
He is to be deported to Samoa on his release.
Ms Fenton's elder sister, Erena Fenton, said the family felt Tiumalu should take his punishment dished out by the courts instead of putting her family through another hearing.
"He's got to be kidding ... he wants to go back now but, at the end of the day, he has to learn a lesson.
"He'll be able to go back to Samoa with his wife and children and get on with his life.
"We haven't got Hayley-Anne to share with our family now ... he needs to serve his time."
Her two daughters, Nadia, 5, and her unborn baby along with her brother Freddie's baby would not get to spend time with their aunty because of him.
"He can get on with his life with his family. We can't. My daughters will never get to see their aunty or meet her ... He just wants to forget it and put it all behind him.
"He disrespected his family. He disrespected his wife and his church and disrespected his culture and New Zealand society. He broke the law and in this country if you do the crime then you do the time.
"His family will forgive this but he treated Hayley-Anne with the lowest form of humanity.
"He didn't get her help when she needed it. He still has a life. He still has his family unit."
Meanwhile, Ms Fenton said she missed her sister terribly as did the rest of the family.
"I miss her but I can't change what happened.
"All I have left of my sister is memories but Pelesasa has his family and the future experiences with them."
A spokeswoman for the New Zealand Parole Board said they were aware of the deportation order but Tiumalu was being "seen in accordance with the statutory cycle".
He last appeared before the board in June 2012 and will immediately be deported on release from jail.