Agree with the others, a very gentle use of a fine file or stone/diamond lap in the dings only should be all thats needed. Fingernails are incredibly sensitive in gauging progress when passed over things like these.
I personally would be wary of trying to be too agressive as you could end up make things worse.
It’s the sort of job I would put on the side of the bench and just have a go every so often when you’ve got a spare few minutes, rather than find it getting tedious because of the number you’re trying to do in a big batch!
Treat it as therapy – nice bit of straightforward, calm work, not much thinking?
Mike