That raised concerns that white supremacists could be infiltrating New Zealand's military.
Extremist group Wargus Christi claimed online that the arrested soldier was part of its organisation, RNZ reported. It described itself as a "martial-monastic Christian brotherhood".
In an internet chat room, members spoke about how the man was removed from the group after news of an investigation.