"We may need to take a medium to long-term view and slowly build it up.
"When people see pricing, it will gain momentum."
As well as fresh produce, the Growers' Market would include a meat company and bakeries.
Hawke's Bay Farmers' Market chairman Mark Verry said the new venture would take a toll on the established Sunday market and, if stallholders to both markets ran out of produce on Saturday, they would "simply not turn up" to the Sunday market.
Black Barn events manager Francis de Jager said the Growers' Market would dilute community resources "by individual organisations pushing their own barrow without the thought, support or dialogue with existing successful Hasting District and Hawke's Bay event stakeholders".
Black Barn has a Saturday morning market in summer.
Farmers' Market stallholder Clyde Potter of Epicurean Supplies said he would not be supporting the Hastings CBD Growers' Market.
"I think it is rather short-sighted of the Hastings District Council and I think if the viability of this market is undermined we stand to lose something for Hawke's Bay."
The Village Press owner Wayne Startup has been at the Farmers' Market for 14 years and said he would not be supporting the Growers' Market with his olive oil.
"One of our biggest customers is New World Hastings and we don't think setting up just down the road from them is a real smart thing," he said.