Hello Ian – you will probably get a lot of conflicting advice over your problem. It might all come down to what is acceptable to yourself. Yes, you may well have made the pins oversize which has caused the cracks but if you can live with "faulty" wheels then that should be OK.
I am definitely not a perfectionist but I would have to bung the lot in the bin, get new castings (maybe from a different supplier) and start again. Its painfull, expensive but you'll sleep sounder.
Rik