There are "significant weaknesses" in the way New Zealand banks govern and manage conduct risks, and changes need to be made, according to the FMA and Reserve Bank.