Emergency services were alerted about 4.50pm after the man was seen looking distressed in the water.
In a statement, police said the man went under water while swimming and failed to surface.
Police, St John and firefighters were called to the scene and were taping off a viewing platform and getting people out of the water in a swimming hole at the top of the falls.