Mr Shearer said he stood down Mr Jones immediately because he had made a point of saying he would stand down any of his MPs who were under investigation.
Speaking to TVNZ after the verdict today, Mr Jones said he was always innocent and he blamed the media for an unnecessary witchhunt.
Mr Jones said he had little option but to let the investigation happen.
In the meantime he would take some time out to think about whether he wanted to come back to politics after the investigation.
"I'm dealing with what the issues are in front of me in terms of the four-year-old decision and longer-term questions about ongoing involvements in politics, I'm not making an announcement about that at this stage."
Mr Jones said he supported an inquiry.
He was angry about Department of Internal Affairs evidence in Mr Yan's court case relating to the speed with which he processed the citizenship decision.
An Internal Affairs official said the department was under pressure to hurry the application through and Mr Jones had granted citizenship only one day after he received it.
Information released first in 2008, and again by Mr Jones this week, showed it was actually more than three weeks later.
Mr Jones said the evidence was incorrect and had maligned him.
He said he made the decision on humanitarian grounds because a senior official told him Mr Yan risked execution if he returned to China.
A Department of Internal Affairs spokesman said officials were checking their records to see if Mr Jones was verbally advised that Mr Yan would be executed.