Community magistrate Janet Holmes granted suppression until the man's next appearance in September.
The man did not speak but was seen taking off his T-shirt and laying his head down on the counter during the hearing.
He was arrested after an extensive police search on Tuesday evening in Browns Bay on Auckland's North Shore.
Part of East Coast Rd was blocked off by police during the search, but cordons have since been lifted.
Tamaki Makaurau Police Inspector Jason Homan said the man was arrested without incident on an existing warrant.
Homan reassured the community there was no wider risk and thanked the public for their patience while staff worked in the area.