Having a .40, myself, as well as a .32 and a .36, I can't see getting another .40 when you already have a good one. I don't hunt much at all anymore, and like you; I shoot targets. Powder is expensive so the less it takes to make the gun work, the better (for me). At the range I shoot my .32 and .36 more than any of the others. During a full shooting session I normally don't have to swab the bore out even once and the accuracy stays shot after shot. If you use the right lube - a liquid lube - The bore will have just the fouling from the first shot. Also a thick patch is needed; I use a .024" patch lubed with Hoppes BP lube. As far as cleaning goes, the .32 is no more prone to fouling than a .54. I cast my own ammo and Lee molds are cheap. If you are determined to go larger, the .54 would be my recommendation. It shoots moderate charges very well and won't break the bank.