It sounds as if you might be feeding too hard.
basic principles.
The tool needs to be sharp
The tool needs to set on centre height (Too high and it will rub not cut )
Cutting speed for a HSS tool should be about 100 feet per minute.
Feed rate should be no more than 0.005" / rev. You need to learn how to turn handwheels steadily. About the first thing that my Turning instructor insisted we do.
So cutting a register about 3/8" deep recess, running at 125 rpm should take 40 seconds, MINIMUM.
You should not be trying to take it all out in one pass. Your aim is to produce a register to a fine limit.
Boring tools are notorious for Springing, so that taking a second cut, without altering anything will result in more metal being removed. For what you are aiming to do, I would suggest a depth of cut of 0.005", stopping the machine, winding back the saddle and measuring., and taking at least one spring cut until required size is reached. I have known as many as six spring cuts being taken before the tool stops removing metal!
HTH
Howard