Back in the 70s, standard instructions for drilling in automatic lathes was first peck after 3 diameters depth, then 1 peck for each diameter thereafter.
But I suspect that was more for surface finish in the hole than straightness – although of course they're not entirely separate issues.
I've come to the view that – given the grind is symmetrical on angle and lip length – pressure is the most significant variable under user control. If you feel vibration through the tailstock handwheel, there's likely catch-and-slip going on at the cutting edge. If you can eliminate it by backing off a little and then applying light forward pressure you might well keep the hole straight enough.
Endmills or slot drills are much more rigid than jobber drills, but they also cut on the helical flute land, which a twist drill doesn't, so you can be exchanging the risk of a bent hole for an oversize one unless tailstock alignment is very good.
Like a lot in engineering, it's a matter of particular circumstances, priorities of different features of the hole, time, cost and patience pressures on the operator, etc.
Edited By Mick B1 on 14/07/2022 10:42:05