The advice given in the operator handbook for mini lathes with brushed motors, is always to set the speed control to Minimum before starting. This has been my practice, and for the little use that the lathe has had, (and its previous owner) without damage.
From what I've read on this Forum, failure to do this is likely to result in damage to the control board. It seems to blow the output FETs, and result in a bill near to £100 for a replacement board.
Inverter VFDs are usually programmed to ramp up the speed from Zero to the selected level over a few seconds.
(Mine has survived fourteen years of casual abuse, without problems; so far!)
My advice? Err on the side of safety, and always set to minimum before shutting down, or starting up.
Howard