After the host asked him whether he was saying the women had all lied, Cosby cryptically replied "you know better than that".
"I won't, and I cannot answer that," Cosby said. "It's really not fair, and you know that because all I have to do is say something similar to that and the next thing I know the postman is carrying a big bag, or whoever it is, it's saying 'defamation, defamation, defamation'."
Following statements from Cosby's daughters which pointed to racism as a motivating factor behind the accusations, the radio host asked the comedian whether he agreed.
"Could be. Could be," Cosby replied. "I can't say anything, but there are certain things that I look at and I apply to the situation, and there are so many tentacles."
He also hinted that he may want to return to performing in the future.
"I still feel that I have an awful lot to offer in terms of my writing, in terms of my performance," he said.
At the end of the interview, Cosby thanked the host, before adding: "I just hope I'm not in trouble now, man."
His trial is set to begin on June 5.