A look inside Spark's new way of working.