The fishing vessel Amazon is currently working through the debris to see if it contained anything of interest.
Senior Sergeant Cynthia Fairley told Newstalk ZB the prospects of finding the pair alive were "grim''.
"At this stage they have come across fish bins and pieces of wood,'' she said.
Ms Fairley added that the search would be scaled back tomorrow to a limited area.
Teams from Invercargill and Te Anau were coordinating the search and rescue operation and they would decide on whether to use the police dive squad to look for wreckage, which could be 40 metres deep.
Ms Fairley said they would need to consider the location, depth, tidal movements and the weather.
"Our thoughts are with the families of the missing men at this tragic time,'' she added.