Based solely on your description of your gun, I'm going to venture a guess as to the source of the problem. I think it is how you are cleaning your rifle after you finish shooting for the day. If you are swabbing your bore with a cleaning agent much as you would clean a modern cartridge gun, that would be your problem. Muzzleloading rifles must be cleaned with soapy water. I prefer to have my water about as hot as you would use to wash your hands. Remove the nipple and if you have a clean out screw, remove it, too. Flush your barrel with the hot soapy water and then rinse with clean water. If you have a clean out screw, clean this area with a pipe cleaner. Also clean the hole in which the nipple goes with a pipe cleaner. Wipe the bore dry with several dry patches and then spray it WD-40 to remove the last of the moisture. Then wipe the bore with several dry patches until all of the WD-40 has been wiped out. Then run a patch with something like Birchwood-Casey's Barricade through the bore to protect it from rust. Clean your nipple with an old tooth brush and make sure to clean the fire channel with a small wire. Flush with clean water and blow dry or rinse with alcohol and let dry. Put a tiny bit of grease on the threads before putting it back in your barrel. Clean the clean out screw with the tooth brush, rinse it and dry it. Put a tiny bit of grease on its threads also.
Before loading again, wipe the bore dry with a couple of dry patches to remove any oil and then snap a cap to be sure that your fire channel is clear. Once you have done this, you are ready to load. Cleanliness is absolutely essential if you want your rifle to fire the first time every time. Follow this procedure and you will have no problems.
Oh, and one other thing, if you are going to shoot substitute powders, you must use magnum caps. The regular caps are not hot enough to reliably ignite substitute powders. They will work...sort of, but you will have misfires. Switch to magnum caps if you happen to be using regular caps.