Prime Minister John Key said yesterday that Dr Smith would have been "silly" to take legal action.
Mr Haynes told Radio New Zealand today they had received good assurances from Mr Key that Fish and Game's statutory role was set to stay. However, they had expected those assurances to be backed up in the house by Dr Smith, which didn't happen.
"Nick's used his time in Parliament to basically defend his own position.
"We were expecting him to acknowledge Fish and Game's role, that he wasn't going to be changing our statutory basis, that he wasn't going to be changing our money supply system from license fees.
"It leaves us up in the air really. Nick is our minister, you have to have a trusting relationship with the minister. I think our chairman has made it very clear that it's very difficult now to be in that trusting relationship with Nick given the missed opportunity yesterday."
Mr Haynes said the organisation was now planning on writing to the Government and asking to have its position formally clarified.