Yes I agree. The position of the ramrod should have zero effect on the bullet or shot pattern.I have had the rammer on many sxs go forward on the first shot but never have they done as you suggest.
How many times has this happened to you?
As an aside, I have a ml that is old but not 'original' that has a ramrod that extends 5 or 6" beyond the muzzle. It has never effected the bullet pattern on target.