"We have more than a million children in New Zealand and this ministry is unashamedly focused on those that are most at risk."
Jacinda Ardern, Labour's spokeswoman for children, said it showed the Ministry for Vulnerable Children was "a pretty expensive re-brand exercise" for Child, Youth and Family.
"If they're not going to get the budget to lift the well-being of kids generally then it's just going to be CYFs with another name."
She said it was an opportunity for a Ministry of Children which would lift the well-being of all children.
"Ministry for Vulnerable Children indicates that work will be unlikely to happen and a lot of children who would benefit from taking a different approach simply won't benefit."
Tolley later told the Herald she believed the UN committee's concerns were based on a misunderstanding about its purpose as a ministry delivering to children who faced "abysmal life outcomes" without intervention.
"I think they thought it was encompassing much more than it actually was and it covered a broader range of children in New Zealand."
It had not given her cause to rethink the ministry or its name.
Tolley said it was a small portion of the session which went for 7.5 hours over two days and ranged from breast feeding to concerns New Zealand children were allowed to drive a tractor at the age of 12 and work part-time.
Tolley said she had explained New Zealand's labour and compulsory schooling laws, saying New Zealand was a farming society and jobs such as a paper run were common.
Ardern said she had driven a tractor herself at a young age and believed that and jobs such a paper runs were part of New Zealand life that need not change.
However, she said Tolley had come up short on questions such as homelessness and poverty by refusing to set a target for child poverty.
Tolley said the New Zealand delegation included Children's' Commissioner Andrew Becroft, and officials from agencies such as the Police and Department of Internal Affairs to discuss work under way with other jurisdictions in areas such as child exploitation.