Prime Minister John Key has apologised for a joking reference he made to convicted murderer Phillip John Smith fleeing the country.
Smith flew to Chile using a passport obtained in his birth name while on temporary release from prison on Thursday.
Chilean authorities have confirmed that Smith then took a flight to Brazil.
In Beijing for the Apec summit, Mr Key laughed on Monday as he told reporters he would alert Chilean President Michelle Bachelet about Smith when they met.
"I'll just let her know there's someone who could be out there from New Zealand that you may not want to invite round for lunch," he said.
He told media in Beijing late yesterday that he regretted the comment.
"Obviously it was a very poorly placed attempt at humour. I regret that, and I unreservedly apologise."
He said he had "misinterpreted the question" when he made the joke.
Mr Key said he would be receiving an advice on whether a wider inquiry needs to be undertaken as well as the inquiry headed by police, the Department of Corrections and the Department of Internal Affairs.
It could take the form of a ministerial inquiry, he said.
"We're very concerned about an individual which was on short term release about how and whether he was properly monitored during that release," he said.
The inquiries would also look at whether the procedures for temporary releases needed to change and why he was able to get a passport without "setting alarm bells off".
He wasn't convinced Smith would stay in Brazil.
Mr Key's joke raised eyebrows on Twitter, with Labour's corrections spokeswoman Jacinda Ardern among those to criticise the remark.
"Just heard the audio of John Key talking about Phillip Smith's escape ... and joking about it. Really Prime Minister?" she posted.
Zoe Walker added: "Did John Key seriously just get the giggles when talking about Phillip John Smith? WTF".
Herald columnist Tobey Manhire tweeted: "The greatest threat to PM Key has always been Comedy John. RT @hdpaNEWS: Phillip John Smith lols?"