The incident occurred on Thursday, which was a sitting day meaning MPs were at Parliament. Prime Minister John Key was in Auckland.
Glock 9mm semi-automatic pistol. Photo / iStock
Former police negotiator and detective Lance Burdett, who has VIP protection experience and now runs a private company dealing with negotiation skills, said leaving a gun behind as a protection officer was the "ultimate sin".
"When you train you very nearly shower with it, it never leaves your side. If you get caught without it in training, the consequences are massive."
DPS officers would likely wear the weapon on a holster that sits around the hips, and that was normally taken off to use the toilet, Mr Burdett said.
Mr Nash said that he did not think any change in procedure or rules could 100 per cent prevent such incidents.
Stuart Nash, Labour MP. Photo / Paul Taylor
"I certainly wouldn't recommend that the [police staffer] is fired or taken off duties. But I suspect that they will never, ever do this again.
"It is a cautionary reminder that they just need to be incredibly careful while they are carrying firearms. We are just lucky that it happened in a place where security is tight and is full of responsible people."
Superintendent Chris Scahill, police national manager response and operations, said in a statement that the gun was left only briefly, with staff soon attending and recovering it from the "occupant".
"And we would like to thank them for their assistance," Mr Scahill said in a statement. "This was a regrettable incident that we are taking very seriously, and we acknowledge the potential risk that this could have posed."
Police would not provide further comment while the matter was under investigation.
Free guided tours run on the hour at Parliament daily, and there are often other school and education visits.
The Diplomatic Protection Service is a branch of police that has an office at Parliament, and is also responsible for the protection of the Prime Minister.
Spokespeople for Mr Key and Police Minister Judith Collins declined to comment.
Parliamentary Service communications manager Kathy Milne said her department was speaking to police about the incident.
"Certainly we would like to see the findings of the police investigation," she said.
Parliamentary Service would also be carrying out its own inquiry.
"Obviously we're concerned about something like that taking place at Parliament. We're quite keen to get more detail on that and find out from police how exactly that happened."