"Part of the Prime Minister's disappointment at these events and the inappropriateness of his behaviour is that in almost every other respect his interaction with New Zealanders is positive."
Mr English said the case of Aaron Gilmore, a former National MP who left Parliament in 2013 after Mr Key criticised him for his treatment of a waiter at a Hanmer Springs restaurant, was different and had been dealt with appropriately.
Women's Affairs Minister Louise Upston also again refused to denounce Mr Key's actions specifically but said anybody subject to unwanted touching or words should speak up about it.
Ms Upston has come under fire from Opposition MPs for her response to a waitress' complaint that Mr Key had repeatedly pulled her ponytail despite her frustration, something Ms Upston had described as "light-hearted".
This morning Ms Upston repeated earlier statements that Mr Key had apologised "and that is the end of the matter".
Asked about it by Green MP Jan Logie in Parliament, Ms Upston said Mr Key had taken responsibility for his actions.
"I do want to take the opportunity to highlight that it is an issue anytime anyone, male or female, is subject to words, to texts, to messages, to touching that is unwelcome, absolutely they should stand up, they should comment, they should express that."
Ms Upston said it was also important for anybody witnessing such behaviour to speak up about it. Asked why she had not spoken out against it, Ms Upston said Mr Key had taken responsibility and she did not intend to comment on it.