Tovey said he had "abused" a position of authority - "for which I am extremely remorseful".
"I am deeply regretful for the hurt I have caused her emotionally and psychologically," he said, adding he could "only hope - and pray" that in time the victim would make a full recovery.
Asking the court to receive his apology on behalf of those he had hurt, including family, friends and the church, he said: "If I could turn the clock back and undo this behaviour I most certainly would do so. Sadly, that is not possible."
Tovey had been a vicar in North Canterbury and parishes of Churton Park in Wellington and in Wainuiomata before he moved to Hawke's Bay.
He was stripped of his "permission to officiate" when the church learned of the allegations against him this year, but yesterday Bishop of Waiapu the Rt Rev Andrew Hedge confirmed he had decided before the sentencing on disciplinary action known in the Church of Canons as "deprivation".
It meant that Tovey would "no longer hold the office, or perform any function of a priest in the Anglican Church in New Zealand and the worldwide communion".
The offences happened in a role "separate to the church" but the bishop said that "foremost" in his mind was that a woman who relied on the care of Tovey - "a priest" - had experienced "pain, hurt and distress" from his actions.
"I am appalled and disheartened that a priest, upon whom there are clear expectations from the church and the wider community, has caused so much hurt and abused a position of trust as a provider of care and as a priest," Bishop Hedge said.