Our original poster (OP), Scoper05, was concerned about shooting 1fg powder in his 50 caliber rifle. He doesn't have a smoothbore or he wouldn't be faced with a "dilemma".
BrownBear has brought up a very valid point about the management of fouling. We don't want the fouling to build up into a hard ring at the breech or to fill the grooves making a change to the bore. Some of us wipe between shots, but that can (and will) push fouling to the breech and eventually block the touch hole/flash channel. One of the better ways to load is to load the fouled bore after the shot (although there is the unlikely but possible getting a flash from a lingering ember), put a wad over the powder of a size to push fouling down on top of the powder, and run the ball down, wrapped in a wet to damp patch to wipe more fouling to the breech. This is not wiping, but actually wiping between shots procedure. It works and does minimize the build up of hard fouling.
As most of us have stated, Scoper05 doesn't have a dilemma other than finding the time to shoot up 4 pounds of 1fg powder or figure out how to justify spending money to be able to use up his free powder.