If the key is a woodruff key ( a semi circle ) one way of moving it is to tap on the extrememe end so that it rotates to bring the other end further out of the keyway.
File or stone off any burrs that you may ahve already produced.
1 This should "unstick" the key. If it moves, with a small flat ended punch may it be possible to rotate it even further, even to remove it completely.
(Before searching to se where it has fallen )
2 There should be more material which can be gripped. If it moves, but does not come out completely.
Don't hammer so hard that the key is "mushroomed", or even worse so that the shaft is bent!
If the worst comes to the worst, you can make a new key!
Turn a piece of bar to the OD of the Woodruff key, part it off slightly too long, for careful filing afterwards ) to the correct thickness, and then cut in half . Not actually, since you want to finish up with one semi circle, cut and file away from the centreline, to produce the Woodruff key that you want.
HTH
Howard