Five guns were seized from the Pakistani President's security staff when they arrived at Auckland Airport last night.
Pervez Musharraf and his wife, Sehba, were greeted by Prime Minister Helen Clark at 9pm.
The firearms were discovered as members of the official party passed through Customs and the security people were spoken to by police.
A spokesman from the office of the Police Commissioner said the delegation had been specifically instructed by New Zealand police to leave their weapons on the chartered plane that brought General Musharraf from Australia.
"There was a misunderstanding by members of [the President's] party as to the point where firearms would have been relinquished. They were under the impression that would have been at the hotel," said the police spokesman.
The guns were handed over immediately.
They will be returned when the delegation flies out on Sunday.