So Mr Feeley is safe for now - but perhaps the damage has already been done.
It is, of course, easy to criticise.
But any impartial observer will recognise that the actions of Mr Feeley were stupid in the extreme.
It appears that Mr Feeley has himself accepted this, through apologising for his behaviour and expressing regret.
The fact that the head of an organisation with such an important role as the SFO could make such serious lapses of judgment is cause for real concern.
Regardless of whether they work in the public or private sector, there exists a not-unrealistic expectation on the heads of large organisations that they bring a particular level of judgment and perception awareness to their roles.
On both counts, Mr Feeley has failed miserably.
The case against Mr Hubbard, who in September died in a car crash near Oamaru, was one which polarised public opinion.
His untimely death meant the charges against him were never proven.
However, the simple existence of the SFO investigation meant Mr Feeley's decision to hand out copies of the financier's biography was ill-considered, particularly when weighed against the firestorm of public opinion that swirled around Mr Hubbard.
The same argument applies to the wine incident.
While Mr Rennie has publicly backed Mr Feeley, describing him as an "effective chief executive and leader", it remains to be seen whether Mr Feeley's staff now hold the same view.
