Cross vices can be OK on a pillar drill.
One of the biggest of the breed, 8" size, lives on my Fredrk. Pollard 15 AY as the normal work holding device. Picked up a set of multi-vee jaws, Nu-Tool brand I think, for it which makes work holding pretty easy. Three vertical Vee grooves of different size and one horizontal in each jaw. A couple of sacrificial MFD plates with gripping battens underneath, one big, one small, do for sheet work. Often a few wood screws is the best work holding method for sheet metal.
The 15 AY has a screw jack table lifter as standard so weight isn't really an issue. Extra mass of the bigger vice probably helps. Bringing it home from a Model Engineer exhibition on a motorcycle, Trident T150 V in those days I think but maybe DB32 Goldie, was um "interesting". Objectively its still a rattly latchity rubbishy old thing but it works well enough despite numerous "must give it a work over" comments during the last 25 + years. Hafta lock the slides of course for most work. All set up for fast removal if need be but can't recall the last time I shifted it.
Clive.