"The girl said no and he slapped her across the face with an open hand. The child fell to the floor and when she got up she again asked for her bottle," Mr Fagin said.
He said the man then slapped the girl at least twice more while telling her in no uncertain terms to shut up.
The man left the room and the woman took her daughter to stay at another place on Sunday night before police were called on Monday.
The man was arrested and Child Youth and Family have been informed of the incident.
A Whangarei man was remanded in custody when he appeared in Whangarei District Court on the charges yesterday and will reappear today.