The former US President joins the Keys and mystery guests for dinner and the night at The Landing