A reporter at the scene said the middle section of Pilot Bay had been cordoned off with police cars parked nearby.
A passerby said police arrived about 8.20am after the body had been discovered.
A couple, who requested to remain anonymous, were taking a walk along the Pilot Bay boardwalk when they noticed a body floating face down in the water about 8am.