"It will be 15 floors of concrete sheer wall so it won't look very nice.''
Robt Jones Holdings owns Telco House next to the site.
The historic Palace Hotel was demolished on Auckland Council orders in November 2010 after the Chow brothers' low-rise redevelopment left it unstable.
Last December the brothers, whose wealth stems from their sex and property development businesses, announced the replacement at 75 Victoria St West would be a 15-storey building that would include a brothel, Penthouse Club, hotel and offices.
Heritage campaigner Alan Matson said the scale of the proposal had more than a minor effect on the formally recognised character of the adjacent 20th century buildings.
Auckland's Catholic leader Bishop Pat Dunn is also among opponents.
An Auckland Council report has said commercial sex premises were lawful and fell within a range of commercial and entertainment activities permitted under the district plan.
An council hearing of the resource consent bid is expected to take place in about five weeks.