A single fixing holding the angle plate is not ideal and what has allowed it to move. A bit of jiggling about and you should be able to get a second clamp in if you set the angle plate between two slots rather than at right angles to one.
An alternative if you have a slotted cross slide would be to clamp the angle plate to that and flycut the port face.
I'm assuming you don't have a mill.
Edited By JasonB on 10/08/2022 10:44:44