1:32" should shoot PRB's just fine.
The issue is the faster the rifling, the greater the odds of stripping the rifling with a bore length projectile (pushing the PRB over the rifling) with heavier hunting loads.
I shoot PRB's in 1:28 or faster rifling barrels all the time and for target and small game this is an excellent combination.
The problem is large game hunting loads tend to strip the rifling.
Use the thickest patch you can comfortably load (.018-20).
Also, try using a wad over the powder then load the PRB.
You might find that with a tighter patch and a wad you can get say 50-70 grains or so of 3FG and a roundball to print well. This will be sufficient for deer out to about 75 yards or so in 50 cal on up.
Were me, I'd keep the barrel and shoot the most accurate PRB loads for targeting and small game, then slip a hefty conical in the barrel on top of a stout hunting load for deer on up hunting. The deer won't object to being shot with a projectile that has superior ballistics.
:imo: