Work has started on demolishing the Thain's building on the corner of Victoria Ave and Taupo Quay.