I can't locate the "fancy" image, but here's a list Musketman came up with some time back:
I usually start smaller and open up the hole with a small pen-knife blade and then smooth it with a rat-tail or chainsaw file.
.36 caliber patched ball-------------->3/8 inch drill bit
.45 caliber patched ball-------------->29/64 inch drill bit
.50 caliber patched ball-------------->1/2 inch drill bit
.54 caliber patched ball-------------->35/64 inch drill bit
.58 caliber patched ball-------------->19/32 inch drill bit
.62 caliber patched ball-------------->5/8 inch drill bit
I usually start smaller and open up the hole with a small pen-knife blade and then smooth it with a rat-tail or chainsaw file.