"He said 'I've been stabbed, he smashed my car with a tomahawk or an axe and he stabbed me."
The French man crossed a busy highway and sought help at a car dealership where workers tried to stem the bleeding before paramedics arrived.
"He was just yelling out all sorts of things, he was quite erratic," witness Ian Wood said.
"I mean, he's just got stabbed."
The victim was taken to Sydney's Royal North Shore Hospital in a serious but stable condition. He had suffered stab wounds to the chest.
It's alleged Stevens had also used an axe to damage windows at a Pacific Highway business.
Stevens was refused bail and is set to appear in the Parramatta Local Court on January 4.
Detectives are now working to establish if the men worked together, and what started the altercation.
New Zealand Police said they would not be notified about the incident unless local authorities were already looking for him of if he gets deported.