"The agent [Michael Yim of IMG] called me on the Monday after Palm Springs and said, 'She needed a change, we're going with somebody else, but you can caddie in Hawaii.'
"I'm like well, never in 19 years have I been fired, and I'm still working for the person. What was so strange for me, we worked unbelievably well in Hawaii, the communication and everything was just phenomenal."
Before hiring Matthews, Ko had gone through multiple caddies. She had a slew of bagmen in her rookie year, before winning 10 times in two years with Jason Hamilton - her longest stint with a caddie - during her rise to world number one.
Matthews said the firing was a bit a shock as he thought he'd done a good job since taking on the role.
"I was like, 'This is a bit strange; I didn't think I did that bad of a job.'"
"I wish her the best, but she's gone through so many caddies, she needs to wake up on caddie-player relationships," said Matthews. "Otherwise she'll just keep doing it."
Ko has been world number one for 77 successive weeks, despite her lead atop the world rankings being closed of late by rival golfers So Yeon Ryu and Ariya Jutanugarn.
It's being reported Ko is talking to potential caddie candidates ahead of her next tournament in Texas starting on April 27th.
Lydia Ko's caddies as a professional:
Michael Henderson
Scott Lubin
Mark Wallington
Steve Kay
Domingo Jojola
Mike Cowan
Greg Johnson
Jason Hamilton
Gary Matthews