I'm going to agree with Reb on this one. You are having way too much trouble here.
Stop and really inspect the parts and their relationship to each other. Look at what holds what in place. The pin through the Barrel assembly, the preasure and possible angle of the wedge as it pulls the parts together, the little pins that locate the barrel lug at the bottom of the frame, the recess of the cylender into the back of the frame. Was the gun on full cock or half cock or hammer down when you assembled it?
You solve these problems through thorough study of the design, parts relationsghips and observation of what is happening wrong in the secquences.
This gun should go back together the same way every time. There should be no variation in how far through the slot the wedge goes, how much preasure it takes, top gap, bottom gap etc.
If this is a new gun part of it could be written off as burrs or chip that should not be present. Your cleaning could have just moved the crud from one place to the other. This inconsistancy is almost impossible to diagnose from long distance, but it sounds suspiciously like pure old excessive wear on the barrel frame assembly. If the gun is new, extremely bad QC from the plant. Accept that these brass frame .44 colts on the '51 pattern are some of the cheapest guns available today. QC is doubtful and buying a used copy a risk.
I would hesitate to load this one up. Things might get really wobbley at the first hammer-fall. At the least, your second shot will impact no where near the first, the third in another county. That's what happens when a pistol changes shape each time it is fired.
Remington .44 is stronger, and often more accurate due to the more "acceptable" sighting system. They do seem to come back and pop my second finger of the trigger hand, with the trigger guard, in a manner that the Colt does not. The Colt grip rotates in my hand better.