Emergency services were unable to revive the man, who was thought to have been in the water for about 10 minutes. He was pronounced dead at the beach.
Sergeant Dave Litton of Waihi police praised the lifeguards who, despite being off duty, were in the water within minutes.
"Unfortunately, this tragedy highlights the dangers of fishing off rocks," said Mr Litton. "With the unpredictable nature of the sea, police advise the use of lifejackets or personal flotation devices while rock fishing."
Waihi Beach head lifeguard Daniel Peacocke yesterday told the Herald the man's distraught friends visited the club to convey their thanks.
He said they wanted to raise funds so an emergency flotation ring could be kept at Homunga Bay.
Meanwhile, a 40-year-old man drowned at Fitzroy Beach, in New Plymouth, about 7.20pm yesterday.
Two surfers brought him to shore but he could not be revived. It is understood he was with his son at the popular surf beach.
His death takes the number of drownings to 11 since Christmas Eve.