Former President Barack Obama gave a moving farewell speech before departing for his holiday