Mr Joyce said the Prime Minister would not "reward the behaviour" of freelance cameraman Bradley Ambrose, who recorded the conversation, by revealing what was discussed.
Mr Ambrose has claimed the recording was accidental, and is seeking a High Court a declaration on whether the conversation between the pair was a "private communication" under the Crimes Act. He is also considering pursuing a defamation case.
Mr Joyce said public is not interested in the scandal, claiming the party was averaging 51 percent in the past three political polls taken.
"We've done our own internal polling on that," he said.
"One of the issues we've been asking about is actually the media coverage of the secret tape and asked people simply two options; Are there more important issues to focus on, or is it worthwhile of further attention. Weirdly enough, 81 percent say there were more important issues to focus on in this election campaign than that, and 13 percent said it was worthwhile of further attention."
Mr Joyce defended Mr Key's decision to call the police over the incident.
"He's responded to it in the correct way and somehow he's at fault.
He maintained the taping was similar to the News of the World scandal.
"Secretly taping things is secretly taping things."
"The reality is the average New Zealand is not that concerned about this at all.
"The average New Zealander looks across at places like Europe and France, and Italy, and the difficulty that is there economically, and says how come we're spending so much time talking about this, with eight and a half days to go to one of the most important elections in history.
"I actually think there are one or two people in the media that need to do a bit of self assessment over this weekend and decide what they are going to be talking about next week."