"President Jacob Zuma is the president of the ANC. When I said the entire ANC leadership that has already taken collective responsibility must take the fall, I meant everybody, myself included, including President Zuma," he said.
South African media has reported growing rifts within the African National Congress since the liberation movement of Nelson Mandela, which has been in power since 1994, suffered its worst electoral performance in August.
Unemployment, economic stagnation and scandals around Zuma led voters to punish the ANC in the local government vote, changing the outlook for national elections in 2019.
Publicly, Gordhan has said that he still enjoys a good relationship with Zuma, and that he is hard at work preparing a budget policy speech to be delivered next week.
But investors fear his prosecution on charges of committing fraud while running the tax agency could see Gordhan removed as finance minister, opening South Africa to possibly losing its investment grade credit rating.
Business leaders and rights groups have also voiced their support for Gordhan, and on Sunday the think-tanks Freedom Under Law and the Helen Suzman Foundation said they had filed an urgent court application to have the charges against him set aside.
-AAP