"By that point they were 150m offshore, and drifting out to sea fairly quickly," he said.
The pair were rescued, but one man was dead at the scene.
The other man was flown to Dunedin Hospital, by a second helicopter, with serious injuries. He was discharged from the hospital's emergency department later that night.
A photographer at the scene, who spoke to one of the men with the pair, said they had been out fishing on the rocks after work when the man was swept into the water.
The photographer said the sea was fairly flat at the time, and there was not a lot of wind.
Snr Sgt Benn said there had been similar incidents at Cape Saunders in the past.
"It's not a great place for rock fishing," he said.
"You can get lulled into a false sense of security."
A life ring was installed using a community board grant, following the death of a man fishing from Cape Saunders in 2010.
Te Runanga o Otakou placed a rahui, or temporary closure, from Taiaroa Head to Tow Rock for 24 hours following the incident.