Your problem may be due to the pre-lubricated patches.
Sometimes these can sit on a dealers shelves for years and many of us believe the cotton fibers, if exposed to some oils will break down and loose their strength.
If you didn't collect your fired patches to examine them the last time you shot, be sure to collect them the next time you shoot.
If the patches are torn or ripped where the ball was contacting the rifling, the patch was the cause of the poor accuracy.
If you don't want to get into saving a lot of money by buying a yard of cotton pillow ticking or other thick material, at least look for non-lubricated patches to shoot.
You can lubricate these with vegitable oil, factory made patch lubes or even spit.
If the non-lubricated patches are still tearing or ripping the cause is due to either sharp rifling lands in the bore or sharp edges where the rifling meets the muzzle crown.