"The fact is they need to have a very dispassionate view taken in the SFO as well as other law enforcement agencies when they undertake their work. But it's an error of judgment which he has acknowledged."
Mr Feeley was reprimanded by the State Services Commission after the Herald revealed he had used copies of the Allan Hubbard biography as booby prizes last December and a bottle of wine from the Bridgecorp offices last year to celebrate company boss Rod Petricevic being charged.
However, Mr Feeley escaped serious censure for the actions, which State Services Commission chief Iain Rennie said were "ill-advised" and showed a lack of judgment.
Mr Rennie said he would make it clear to Mr Feeley what the expectations were for behaviour as CEO and caution him to act with care.
He said Mr Feeley had apologised to Ms Collins for causing her "unnecessary embarrassment".
Ms Collins yesterday released the written apology, under the Official Information Act, which Mr Feeley sent after the Herald reported the Bridgecorp drinks party.
Mr Feeley wrote that he was disappointed the "lapse in judgment on my part" had undermined the SFO's work.
While his focus over the last two years was about delivering good results to Ms Collins and the public, he admitted the the incidents "inadvertently diminished the public perception of those efforts".