Just don't stand in the way!
A common technique I will undoubtedly try someday. I am pretty sure the trick is to minimise cutting forces, that means tiny feeds, sharp tools, cutting off a ring, etc, etc.
3mm sounds a bit chunky, but I don't see why not, just work across the face maybe having cut off the excess with a jigsaw.
As it is saving a huge amount of filing time I am sure its worth being careful.