"For us to stop and pause and acknowledge someone for the work they've done and for them to see us acknowledging them is really important," he said.
"It's no mean feat to spend a decade in one role, one place, doing a job."
Mr McKee said Mr Te Huna had "obviously made quite an impact," in Whanganui.
Mr Te Huna, also known as "Poppa", said he joined the security team at Whanganui District Court when he "got sick of driving around".
He was working for Newmans Coach Lines when the opportunity to work at the courthouse came up.
He said he enjoys the "camaraderie" of his job and likes talking to members of the public and helping them out.
Mr Te Huna said his colleagues were his "second family".
Dealing with people he knew was harder.
"You know that they come to court and you think, 'Oh no, what are you doing here?'."
He said Wednesday's celebration was "a real honour".
Regional security manager Massey Coffin said Mr Te Huna was "extremely popular and well liked", while Mr McKee called him "personable".
Colleague Sheryl Chapman said he had "a good heart".