Just came in from shooting my 36 cal. longrifle, 1 in 48 twist, Green Mountain barrel. . I'm still getting the barrel shot in, but I use a .350 Speer ball, .015" precut pillow ticking patches, which are tight enough that I have to use a short starter, and a fair amount of push to get them seated. My normal load is 30 grains 3f. The gun shoots as good as I can see and hold at 25 yards. At 50, my groups are about 3", and at 100 I can keep all shots on a piece of writing paper, but I have a hard time focusing everything at that distance, so I'm sure the groups would shrink if I could still see well.
You should try different loads and patch thickness before moving the sights too much. Mine shoots to the right with a loose patch, and to the left with tighter patches.