What have you tried for loads specifically?
The issue most likely isn't the jug choke.
My best roundball loads are usually with wads instead of patches. But, I don't have a jug choke. I would think the jug choke might create problems with a patch because it gives an opportunity for the patch amd ball combo to loosen when it enters the jug.
As Loyalist Dave said, there is no evidence of patches being used to shoot roundballs from smoothbores during the period. (Although I have some alternate theories on this specific to smoothrifles)
Here is what I have tried. Two different smoothbores like different things.
Powder preceds each of these combos.
Thin "overshot" card/s (one or two), lubed felt wad, ball, two thin overshot cards.
Nitro card, lubed felt wad, ball, thin card/s (neither gun shot this well, but I didn't try it a lot with other variables)
Dry felt wad, lubed felt wad, ball, thin card/s
Thin card, lubed tow wad, ball, thin card/s
Lubed tow wad, ball, thin card/s
1x2 inch strip of brown bag paper "rubbed soft" folded to 1x1 seated on powder, lubed tow, ball, thin card/s.
Just a theory in the back of my head, maybe try some of the combinations listed that use more flexible wadding behind the ball. This should allow them to expand when they reach the jug allowing them to maintain the gas seal.
One of my guns really didn't seem to do well with hard objects behind the ball, felt wads, tow, paper and tow, all seem to shoot better in that gun.
Just a disclaimer on the above. I am not using real flax tow, I don't have any and don't have a regular local source. I am using what I call, "faux-tow" which is just 4 to 5 inch pieces of sisal rope sections shredded then balled up amd rubbed in my lube, then I try to work the lube into the ball really well and reform into a ball slightly larger than the roundball I am shooting. When I take one out of my bag to load I smush it then force it into the muzzle.