"They need to understand that that's the risk they're taking. So I'll explain that."
A Google spokesperson has said the tech giant would comply with any court order, but it didn't know about the suppression order in the Millane case.
Little said that excuse wasn't good enough.
"This thing about they didn't know it was suppressed, I simply don't accept that.
"Irrespective of that, and yes, this might be the way of the world and modern technology, but the reality is that we cannot surrender the effective administration of justice to algorithms and machines and say, 'Well, that's it, it's all over for fair trial rights.'
"We cannot allow that to happen."
Little said if fair trial rights were compromised, "nobody gets justice".
"It's not just the defendant directly affected. It's the victim as well. We have these rules for the benefit of victims as much as anybody."
Earlier this week, Little chastised British media for naming the accused, and now a close friend of the Millane family has written to London's major newspapers asking them to refrain from breaking name suppression.
The Government has said it is not currently looking at changing the laws around name suppression, even though the 20-working day suppression order has been criticised as too long.
Little said that New Zealand media also should respect suppression in other countries, given that some New Zealand media had named a public figure who has name suppression and faces historical sex charges in Australia.
"We should be respecting suppression orders handed down by other judicial systems to make sure fair trial rights are not compromised on those countries," Little said.
"To the extent that New Zealand media have not honoured that, I think that is grossly unfair."