It would be done "in such a way that we can keep the dignity of the person in there", Mr Horne said.
The park scene has since been blessed and the park has re-opened.
Enquiries were continuing and there would be no further police comment until the identity of the man was confirmed, police said.
Rotorua's Deputy Mayor says it's impossible to fence off all geothermal features in the city.
Dave Donaldson says there are hundreds, if not thousands, of them in public spaces.
Mr Donaldson says a number of geothermal features in high profile public spaces do have safety fences.
He says the council has been very proactive in installing warning signs where it's felt there's an element of risk.
Additional reporting: Newstalk ZB