I’ve browned barrels unfiled or sanded, with slow cold brown, took two weeks but I can’t tell it from filed. White or blued you have to polish.
That said I would not brown with out a polishing, but as said you don’t want to go too fine, past 200 grit or it makes it very hard to get a smooth color. Experience here.