"Affected product should not be consumed," the ministry said.
"If you have consumed this product and have any concerns about illness, seek medical advice."
READ MORE:
• Commercial operators snapped by MPI for fishy business
• Coromandel police, MPI sting sees 150 paua, 284 kina released, poachers fined
• Covid 19 coronavirus: MPI's rules for food businesses opening under level 3
• MPI fires stark warning to 'risky' unpasteurised milk retailers
Krazy Mart issued an apology on its Facebook page, saying it was sorry for any inconvenience caused by the recall.
The toxin found in the fish can cause ciguatera poisoning, and symptoms usually appear within six hours of consumption.
The symptoms include nausea, vomiting, diarrhoea, or muscle pain followed by neurological symptoms including headache, temperature reversal, dizziness, tingling, muscular weakness, or an irregular heartbeat.
It was usually associated with imports of reef fish from the tropics, and was not known to be in New Zealand fish apart from some species caught in the Kermadec Islands.