The retaining caps should not be too tight because the glass can easily be broken, hense soft neoprene rings as Chris has suggested. Normal o-rings are hard and require reasonable force to compress. Sometimes used on full size boilers but not suitable for small fragile models.
If you are unable to find suitable neoprene tubing to make rings, you can use flat teflon sealing tape by twisting it into a string and wrapping the string around the glass. Not as good but will get you out of trouble.
Paul