"Corrections is also undertaking a review of the incident."
The prisoner was released from hospital back to Paremoremo prison on May 9, however he was returned to hospital on May 13 due to staff's concerns for his health, Langley said.
"We have a zero tolerance for violence policy, and any violence or assaults against other prisoners or staff is not tolerated in prisons," Langley said.
"Any prisoner using such behaviour will be held to account for their actions, including facing criminal charges."
Langley said they were constantly working to ensure prisons provided the safest environment possible for staff and prisoners.
"Our staff manage some of New Zealand's most dangerous people in a complex and challenging environment.
"Over 75 per cent of the prison population have convictions for violence in their offending histories, and more than 90 per cent have had a lifetime diagnosis of a mental health or substance abuse disorder."
Attempts had been made to contact the victim's next of kin, Langley.
"As the incident is subject to police investigation and for privacy reasons, no further information will be provided."