I am no expert at reading patches, but I'll tell you, a .535 actually cuts my patch in my hawken whereas a .530 leaves a patch you could almost reuse after shooting. I see no cut marks or indentations on your patches.
However, if I shoot 90 or 100 grains, my patch looks about like yours, all frayed, and even scorched somewhat (my best performing load is 65-70 grains...)
I suspect if you back off your powder charge, the problem will just go away on its own. I don't think the fraying is because theyre too tight. Just try this: shoot a group, back off 5 or 10 grains, shoot another, and repeat, backing off 5-10 grains with each group. Let your new load be whichever is your best group. See if the problem goes away. If it doesn't, and you still have frayed patches, try then adjusting thickness of ball and patch combos. But I suspect you are loading too hot, or that your patches are too dry. In fact, i would bet if you load much hotter, you would see burns all over those frays.
Now, needing a hammer to start your ball would be a sign that you are too tight...and you may be. But i don't see it from the pictures, your load is literally blowing those patches apart, which seems to be the bigger issue; and your accuracy will probably increase without all that gas-escape occurring when you back off on the powder.