"I will be commissioning an investigation so that we get to the bottom of this and learn from our mistakes," Scott said, adding "integrity and ethics are fundamentals of sport".
According to the report, former staff members attempted to raise allegations of Peden's inappropriate behaviour with Cycling NZ several times over the past few years.
The issues are alleged to have included bullying, drinking and Peden's relationship with an athlete but nothing was done, the staff members said.
Peden had been CNZ head sprint coach since 2013 but resigned unexpectedly on Wednesday.
CNZ chief executive Andrew Matheson earlier said Peden's departure wasn't entirely unexpected.
"It has been a tough journey through the world championships and Commonwealth Games, so it [Peden's decision] hasn't come out of the blue."
Matheson refused to comment on the reasons for Peden's resignation, merely saying "it relates to an employee-employer relationship".
Peden guided the men's trio to three titles and 10 world championship medals, an Olympic silver at Rio and 14 Commonwealth Games podium finishes, including golds in team and individual sprint and the development of the women's programme to unprecedented levels with four medals on the Gold Coast.
Requests for comment from Peden were unsuccessful.