The demolition of Cornwall St School has upset residents who say noise from the job is horrendous.
Contractors Bruce Buchanan began demolishing the disused bike shed and bus shelter on Monday, and continued work on the classrooms on Thursday.
Cornwall Park Motel owner Pauline Dickson said she couldn't believe the demolition work was taking place over summer - her busiest time of year.
She said the neighbourhood was usually quiet which attracted most of her guests, and noise started at 7.15am on Thursday.
"Why couldn't they do it when it's not the peak of summer with the wonderful weather and people enjoying the unique grounds outside?"
She said the noise levels were lower and work started later yesterday.
Another resident, who would not be named, was not impressed with the timing and noise the demolition work had created but understood it was necessary.
She said it was sad to see the buildings go although there had been a "slow destruction of the school buildings by mindless youths".
Although the Ministry of Education did place public notices in newspapers, the residents both said more notification to immediate neighbours would have been preferable.
Tasi Sala, contract manager for Bruce Buchanan, referred questions about the noise complaint to the ministry. A ministry spokeswoman was not able to answer questions by deadline yesterday.
In a previous statement, it said the site has not been used since 2004 and has become a target for vandals which was why the work was undertaken.
The work is expected to be completed in mid-January.