Exactly ... it's all about finding your sight picture.
For windage, if you have a turtle front sight like mine, you ain't gonna be moving it. I use the relationship between the sight and the tang screw (slot in screw is parallel to barrel to help with this) to adjust my left-right point of aim...