The biggest thing is to have your bag organized, keeping only what you will need to shoot the number of shots you are going to take (between resupplying from your stores), and not a lot of other stuff. It's all too easy to carry too much stuff, in too big a bag, and it become a pain in the behind (my first shooting bag was/is entirely too large, and held everything... including the kitchen sink lol)
Most of the long-hunters would have their mule/horse/wagon carry the majority of their shooting/living gear, and then leaving most of that stuff at their base camp when they were in the field, keeping them light to move around unencumbered. If I'm not intending to shoot a lot of shots, there are times when I go out without a pouch at all, and just have a few balls, extra flint, and a tool set and patches in the patchbox on the gun and a pocket flask (like the ones meant for a pocket colt revolver) (that's a positive for the small bore guns, you can fit a lot of balls and patches in the stock with those). I've never felt the need to use loading blocks, so I don't have much experience with them. My short starter almost never gets used, and lives in my range box (cheap tackle box) most of the time, as I would rather swab my barrel out every 15-20 shots than try to force a projectile through the fouling (which tends to deform the ball or bullet). Then again, all my rifles are shallow-grooved, so I don't need things to fit nearly as tight as some of you guys with deep rifling.
Just be very by-the-numbers with it, so that you don't fumble stuff or skip steps... . Slow is smooth, smooth is fast. Honestly, while you are deciding how to set your kit up, you can do dry runs of loading in your home, just make sure the gun's not loaded and you don't actually load it. Go through the motion of bringing the piece down from the shoulder, holding it while you retrieve your powder and measure, simulate measuring the powder and putting it in the barrel, returning your measure/ powder, then retrieving your ball and patching and starter (if you use one), and then simulate priming. Not much difference between that and going through SPORTS drill in basic rifle instruction indoors. If it seems really awkward after a few dry runs, it's probably not the best arrangement, and you can try something else; and settle on the least-awkward setup until you can get out on the range to test it in live fire.