"Not only do they spoil waterways, they can be very difficult and costly to eradicate."
DoC rangers will use an electric stunning device and nets to capture the fish next week.
Mr Sydney advised people to empty aquarium water into gardens rather than drains or streams and to clean fishing gear, boats and trailers after use to prevent the spread of pest fish and weeds.
An Albert Town resident next to the pond said yesterday some local children would be "devastated" the fish were being taken away, particularly the young boy planning to catch and sell them.
A DoC spokeswoman said "responsible" homes had been found for the goldfish, although it was likely fish in poor condition would be euthanised.