The group has has invited all "tribesmen" in 43 countries to come together to discuss the group's ideas and beliefs, which include legalising rape on private property.
Mr Carley said although people from visa waiver countries do not need a visitor visa to travel here for less than three months, or six months from the UK, they must meet health and character requirements before being granted permission.
"People from visa waiver countries may not be granted entry to New Zealand if they are not considered to be genuine visitors or have been sentenced to imprisonment, deported from any country or suspected of being involved in known criminal or terrorist groups."
Under the department's character requirements, visa applications made by people with "character issues" cannot be granted.
Among the character issues outlined is anyone the minister may have reason to believe is likely to commit an offence in New Zealand that is punishable by imprisonment, is likely to be a threat or risk to security, a risk or threat to public order or a threat to public interest.
Mr Valizadeh, a blogger, caused mass controversy early last year when he wrote an article promoting rape.
"How to stop rape. I thought about this problem and I'm sure I have the solution: Make rape legal if done on private property. I propose that we make the violent taking of a woman not punishable by law when done off public grounds."
His views on masculinity, the need for women to be submissive, fat-shaming and a man's right to superiority have raised eyebrows and led to protests against him.
In New Zealand, sexual violence prevention groups called for the meetings and its organisers to be banned.
Sexual violence survivor and advocate, Louise Nicholas, said the meetings were "scary" and called on police to move to stop them.
"This kind of activity encourages the misunderstanding some people have of sexual violence," said Ms Nicholas, advocate for national network of sexual violence group TOAH-NNEST.
"It's a huge concern as it encourages more violence as well as extremist behaviour."
Wellington Rape Crisis said the group's ideas were "disturbing" and called on all Kiwi men to take a stand and speak up against the movement.
Minister for Women Louise Upston did not want to comment on individual cases. However, other MPs were more vocal.
Te Tai Tokerau MP Kelvin Davis labelled the anti-women group "plonkers" who needed to be run out of town.
Mr Davis, who is also a White Ribbon ambassador, said those connected to the group and its ideas should not be labelled as real men. He referred to their ways as "creepy".
"This group has the collective IQ of your average garden gnome. They should get psychological help to escape their confused, creepy, fantasy world," he said.
"These plonkers don't have any clue about what it is to be a real man -- who loves, respects and cares for all women. They need to stop pretending sexual violence is normal and a man's right."
NZ First leader Winston Peters also had words for the anti-women group's plans to come to New Zealand.
"We do not need this drongoistic, medieval, four-flushing twit in our country breaking our laws."
