Tip I got from an old fly fisherman:
Thin cotton, or even better silk*, gloves with nitrile/vinyl/latex over the top. change over cloves as required.
Robert.
*He used surplus RAF flying under-gloves that were intended to be worn under leather gloves so maybe the idea is not so new.