Don't expect to find obvious logic in Imperial Drill sizes, because they either pre-date or are early examples of standardisation.
Imperial Letter and Number Series drills date back to when manufacturers and trades all had different proprietary Gauge sizes, creating a need for apparently odd sized drills. Gauge sizes seem to be have been determined by the needs of early wire making machines. These progressively swage wire down to create a series of useful diameters, and did so before micrometers existed. Practical rather than scientific technology, and haphazard because disorganised.
Industry has progressively moved away from Gauge systems towards simplified systems based on measurement since Whitworth, Whitney and part interchangeability. ¹⁄₆₄" drill sets were a step in that direction: a compromise that reduced the need to stock Letter and Number drills. Another example was precision machinists dumping fractions in favour of thou.
The Imperial system began as a complete muddle and many sacred cows were slaughtered getting to the much simplified system we know. Still far from rational though. May not matter much for basic practical work, but it annoys design engineers by complicating the maths. Scientists find Imperial positively harmful, because it's internal inconsistencies confuse natural relationships.
Go metric young man! Not perfect, but it meets practical, engineering and scientific needs with a single rational system. With metric there's no need to worry about Letter, Number and 64th drill-sets because drills are available in 0.1mm increments.
Dave