"The spectators carried on fighting. At that stage I took my assistant referees off the field," Holmes said.
"At no time did we feel threatened, but we stopped the game for about 10 minutes and I understand the police were called."
A police spokeswoman said police were called to a fight or reports of disorder this evening, however when police arrived it those involved had dispersed.
"I was just about ready to call the game off if it didn't sort itself out, for the safety of the players and the rest of the public that was there," Holmes said.
After the fight was resolved the match continued, while two players were presented with yellow cards for their role in the melee.
"I felt sorry for them, the game was going really well. It was a good game, it was a close game," he said of the two teams' players.
"You do get a little bit of a tiff in the game, that's natural, and as officials we try and get on top of that and sort it out, but it certainly doesn't help when members of the public get involved."
Holmes said he and his assistant referees will report the incident to the Waikato Rugby Union.
It is understood there were no serious injuries.
Te Rapa won the match 38-21.