Earlier this week, Mr Hay told the Herald his actions had demonstrated he was a far more skilled politician then either Dr Norman or Ms Turei. Today he said he was "contrite".
"I've caused a lot of distress to my fellow party members which I regret, I have implied that Metiria Turei is a part of this which is apparently incorrectly and I unreservedly apologise to Metiria.
"I have pretty successfully dynamited all my bridges now and I'm not sure what happens next."
He was now taking time off work to "reflect on what's happened and get over that".
The Green Party's executive is currently considering Mr Hay's future with the party but Auckland province co-convenor Vernon Tava told The Herald no formal process to eject him was underway.