I have had no problem drilling the common 'stainless' Chinese calipers with ordinary HSS twist drills, in fact I have tapped M4 threads into them as well.
When drilling you need to apply lots of pressure so that you can take a good cut rather than letting the drill rub.
Ian P