Worth knowing too that the tool cuts with a different edge on the backstroke. As a result, the way it removes metal isn't identical in both directions. The effect becomes more pronounced as the tool wears: the front edge wears much faster because it does most of the work.
For what it's worth (I'm self-taught), I don't retract the tool whilst removing metal just to get near the required diameter. I do retract it towards the end – as soon as finish and accuracy matter.
Learning the best way to finish is an acquired skill. Finishing with a succession of tiny cuts is (I think) less satisfactory than finishing with a single slight cut. The tool needs to cut rather than rub. As Bob said 'Lots of practice will get you there.'
Dave