There is a push to have Prince Andrew relinquished of his title of Duke of York title to end his association with the city of York.
Removing the title, which was bestowed on him on his wedding day to Sarah Ferguson in 1986, would require an act of Parliament.
However, the city's Labour MP Rachael Maskell says it needs to happen, calling the current situation "untenable".
"It's untenable for the Duke of York to cling on to his title another day longer, this association with York must end," Maskell told the Guardian.
"There's a very serious allegation made against this man of privilege and entitlement. I'm working with agencies to tackle sexual violence and misogyny."
Senior councillor Darryl Smalley said the city's reputation was being tarnished by the association.
"I think the vast majority of people in York feel exactly the same in protecting the reputation of the city ...
"York is fantastic, we have got a lot to be proud of and one thing we don't want is to be so burdened with this link to Prince Andrew.
"It is important for us as councillors and city leaders that we raise these concerns, just as servicemen and veterans did in their letter to the Queen.
"It's our duty really to make clear that we are very unhappy that despite him not using titles such as 'His Royal Highness' he still somehow retains the title of Duke of York. It seems strange to a lot of us here in York."
It comes after Prince Andrew, 61, was stripped of his military titles and royal patronages by the Queen as he faces sexual assault allegations, which he has denied. His roles will reportedly be redistributed to other members of the Royal Family.
The Duke of York will keep his Royal Highness honorific, but will not use it.
Buckingham Palace said in a statement, "With the Queen's approval and agreement, the Duke of York's military affiliations and Royal patronages have been returned to the Queen.
"The Duke of York will continue not to undertake any public duties and is defending this case as a private citizen."
It comes after Virginia Giuffre claims Andrew's friend Jeffrey Epstein forced her to have sex with the royal on three occasions when she was 17.