The twist rate isn't really a problem with round balls if you pay attention to one small detail.
Most fast twist barrels also have very shallow rifling. Punch your charges up past a certain point, and I think what's happening is the rifling isn't grabbing so well.
Easy remedy. Just go to a tighter patch/ball combo if you want to push up your charges.
My bud has the Hunter barrel in 54, and I've borrowed it and played with it quite a bit to help him get it shooting RBs better.
With an easy-loading combo of .018 patches and .530 balls, you can stack the balls on top of each other with charges up to around 60 grains of 3f. But accuracy starts to go south past 70 grains of 3f. That still plenty hot for deer smacking, but lotsa guys want hotter.
Going to a .018 patch with a .535 ball requires a pretty good smack on a short starter to get the ball started, but it shoots well up to at least 90 grains of 3f, as high as I've gone. Might or might not be even more accurate with 2f, but I never got around to trying it.
One thing to remember with Lyman barrels. When new, the sharp edges of the lands and the crown can cut patches and hurt accuracy for the first 100-200 shots. There's simply a break-in period, following which accuracy will put a real smile on your face. My bud had already shot the barrel quite a bit, so I don't know if it's a factor with the shallower rifling of the Hunter, but it would be something to expect if yours is new, but be pleasantly surprised if not.