Welcome to the forum.
To give you a value for the amount of front sight that would need to be removed, I need the measurement of the distance between the front and rear sight.
To save you some time, I can give you the factor to be multiplied by the distance between the front and rear sight but I have to pick one of your values to base it on.
I guess I will pick the 4 1/2 inch value.
You say the distance to the target is 30 yards.
30 yards X 3 = 90 feet.
90 feet X 12 = 1080 inches.
4 1/2" error/1080" = .0042
This is the factor that you would multiply times the distance between the sight.
Let's say the distance was 26 inches.
26 inches times the .0042 factor = .109" or about .016 (1/64") less than 1/8".
That would leave your front sight around .142 inches tall.
Because material is hard to put back on, I'd suggest that you should take the gun to the range and shoot several more groups to make certain your 4 1/2 inch error is accurate.
It's also a good idea to do the final filing at the range, firing a few shots, filing off a little, firing a few shots, filing off a little...
You get the idea.