"Yep, I've heard it as well, by more than one bloke," said Geyer.
"I'm hearing he's going back to New Zealand. McFadden's out and Garth Brennan, who is a first grade coach in waiting, will take over at Penrith.
"That's the rumour in rugby league at the minute. How true it is we don't know."
Doyle was adamant the Warriors have not enquired about Cleary or any other coach's availability or interest in taking over from McFadden, saying: "100% correct we have not explored that at all."
He suggested the rumour was merely the result of speculation over the futures of both coaches, with the 11th placed Warriors and 15th-ranked Panthers clearly struggling for results.
"I've got no idea where that's come from," said Doyle. "No idea whatsoever. I don't know why people make stuff up.
"I can only imagine it is probably just people talking about what could happen, what might happen, or 'what would you do' type of thing, or would the Warriors be better to get Ivan back. I've got no idea."
Doyle stopped short of guaranteeing McFadden's role was secure through to the end of his contract at the conclusion of the 2017 season, but made it clear the man they call Cappy would be at the helm next year.
"You can't predict anything obviously but we support him and my job now is to get good people around him to make sure that we can make him successful.
"From my point of view that's where our focus is.
"Cappy's our coach and we intend to put people around him to support him and we've got high expectations for next year. There's no doubt about it, and he knows we've got high expectations for next year."