PM: Cunliffe's comments 'pretty silly'