Prince Andrew has surrendered his titles, including the Duke of York, amid growing pressure over a series of scandals, including his alleged ties with late sex offender Jeffrey Epstein.

“In discussion with The King, and my immediate and wider family, we have concluded the continued accusations about me distract from the work of His Majesty and the Royal Family,” Andrew said in a statement Friday evening.

Andrew has been under intense scrutiny over his relationship with Epstein — the American financier and convicted sex offender who ran a network that exploited and trafficked underage girls. He faced backlash over a civil sexual-assault court case brought in the U.S. by Virginia Giuffre, which was eventually settled, and over his involvement with an alleged Chinese spy.

“I have decided, as I always have, to put my duty to my family and country first. I stand by my decision five years ago to stand back from public life,” Andrew added in his statement, “vigorously” denying the accusations against him.

The announcement comes just days before the release of Giuffre’s posthumous memoir, which reportedly details three occasions on which Andrew allegedly had sex with her — excerpts of which were published by the Guardian earlier in the week.

Andrew’s children, Princess Beatrice and Princess Eugenie, are set to retain their titles.