"The problem is David Shearer already made those comments when he was the leader."
He said the GST off fruit and vegetables was "a pretty dumb policy anyway and wouldn't have worked.
Mr Cunliffe said the dumped policies would have cost the Government about $1.5 billion a year in lost revenue and that money would be better spent on polices that gave greater assistance to struggling families.
He would be outlining "Labour's vision for a better, fairer, more innovative New Zealand'' in his state of the nation speech on Monday.
Flagship policies of introducing a capital gains tax and a staged raising the NZ Super age of eligibility from 65 to 67 would remain, but would be tweaked.
The Super age policy was being reviewed to address issues of social and gender equality.
Mr Key said Mr Cunliffe's comments on the age of Super eligibility revealed "internal tensions within Labour".
"David Cunliffe doesn't want to raise the age of NZ Super because he believes it's stupid idea and that's what he's been telling the unions. (Finance spokesman) David Parker does, so they're going to come up with some sort of compromise."
Meanwhile Mr Cunliffe also said the media and public would have to "wait and see" whether he would announce on Monday that Labour would extend Working for Families to beneficiaries.