I am in the process of fitting a key to the base of my big machine vice for quick location in the table slots. I milled a 1/2" slot in the vice base to give a close fit on a bit of 1/2" BMS square, then used Loctite high temp fixing stuff to lock the bar into the slot to drill matching holes. Worked a treat, after drilling the bar could be knocked out with a drift quite easily. Of course in this application the sides of the slot constrained the bar sideways so the Loctite wouldn't need to work that hard.
I have found previously that if I Loctite something in a through hole and place the whole item on a flat surface to cure and some of the stuff leaks through the hole, it does fix quite firmly to the surface but the bond can easily be broken. I'd say give it a whirl – maybe on a test piece first.
Problem with superglue is that it does fix fast, only way to break the bond can be to apply heat, the whole assembly may need to be got quite hot, and the fumes are very nasty.
If the surfaces are nice and flat, another option I've been trying recently with some clock parts is shellac, in the form of carpenter's knotting. You need to apply quite a lot to fill between the items, then leave it somewhere to dry, preferably a hot surface like a storage heater. This can hold well once set and cold, to release get it quite hot again, around 80 – 100 C, when the shellac softens. In one case I boiled the items! Knotting comes in quite large bottles, is cheap, lasts for ever, and safer than superglue. Get it off with meths.