Napier's Work and Income office has reopened after being locked down when threats were made.
Police said that just after midday today a man had threatened staff verbally over the phone.
The matter was taken seriously and police rushed to the area.
Police were now making inquiries into whether any offence had occured and whether charges were to be laid.
They also said the man regretted making the comments that he did.
Acting Senior Sergeant Nigel Hurley from Eastern DCC said: "It's a timely reminder to people that they should choose carefully words that they use when talking on the phone to any business or any person."
"They will be taken seriously and action will be taken."
He said police acted appropriately, "as far as I am concerned the matter was dealt with extremely well".