I have been having the same issue with my 50 cal GPR. What seemed to help the most, after opening the touchhole to 5/64, was using a 30 cal bronze brush with a cleaning patch, to dry the patent breech. You can feel it pop into the breech, then twist it. Works well for me.
Never had this issue...