"Ministers agreed priorities with him and if he had confidence in an individual he just let them get on with it.
"He was arguably the most talented politician we will see in our lifetimes."
Coleman, a GP before he came to parliament, recalled the occasion when Key slipped as he ran up on stage at a Chinese New Year festival in 2009.
"Returning to his seat next to me, he said his arm was a bit sore," Dr Coleman said.
"I advised him to take a couple of Panadol, forget about it and all would be well.
"The next day he rang to inform me his arm was broken in two places."
Coleman, who held senior portfolios including defence and health, had some advice for new ministers.
"They can sink or swim, they have to have big picture priorities to achieve anything."
Coleman is leaving parliament to take up the role of chief executive for a private health care provider.