I'm not completely clear on what you mean with your ticking. If its what I think you mean, and you are shooting a relatively tight group, then it matters not. IMO, 3 shots within the size of a quarter (25 cent piece) is acceptable for starting out.
There could be some sharp edges on the crown area. One way to find this out, and perhaps is the best way, is to inspect the cleaning patches. If they are cut, then you most likely have sharp edges somewhere in the bore. I use old, white Tee shirts cut to size. If there is a sharp edge(s) somewhere in the bore, those will darn sure show it. Had that happen in my GPR. The only way I knew about it was by finding cut places on the Tee shirt cleaning patches.
In terms of the ticking and fraying a little around the edges "Before shooting them" then it could simply be that particular batch of ticking material. As in age, weave, quality, etc. I have never ran across what you are describing, to the best of my memory, but I suppose it may have occurred. As long as the accuracy is there, as well as no bad fliers, then I wouldn't be concerned about it.
As you most likely already know, finding and inspecting previous shot patches is where most attention should be focused, IMO. Fraying around the edges will most likely be present. However, as long as the material is not burnt through, blown apart or have definite cut places where the ball rides, you are golden.
It to my belief that anytime any of the items listed above is found (other than the frayed edges) that is where fliers come from. In other words, and for simplicity, if you find 6 previously shot patches and one is damaged, yet the other 5 have maintained integrity, that one single patch that failed might very well be suspect of a flier. For best possible accuracy, you want every fired and recovered patch to be in good condition. If we ascertain this, then we just eliminated a variable.
From my findings, unless there is something wrong with the .018" ticking (lubed with TOTW Mink Oil) you would be hard pressed to experience any issues listed above when shooting 20.0 grains of 3F Swiss.