"Not only could toxins flow into streams and rivers already struggling under intensive farming pollution, but it puts aquifers at risk and threatens communities," Taylor said.
What do you think? Have your say in our Facebook poll:
He said once the scale of the problem was known, a comprehensive plan was needed to tackle it.
"These dumps must be outlawed. There are schemes and reputable companies which handle such waste safely and efficiently and it should be compulsory to use them."
Environment Canterbury spokesperson Davina McNickel told RNZ said the council was looking into making it easier for farmers to get rid of their rubbish.
She said that at the moment they really didn't have many options.