A helicopter was sent and the man's body found just before 10pm, police said.
"It appears that he had fallen near Pinnacles Hut."
Roberts said the man was not involved in hut-related duties when he died.
"It seems he was out for a walk, he was well off the track ... he's been up on the side of Mt Somers and fallen in a very bluffy area."
The man's death has been referred to the coroner, and the department would also investigate the circumstances, Roberts said.
Police have not yet released the man's name and Roberts did not want to say where the man was from without permission from his family, whom they plan to meet with this afternoon.
Colleagues of the man were "really upset", and being supported, as were those closest to the man, he said.
"It's his family and friends we really feel for at the moment ... we're looking to do what we can to support them."