It should be polished bright first, since the color case is one form of oxidation, and the idea is to get a nice, even oxide coating of rust by browning. I suppose you could try browning over the color case, but it might not come out right.
mhb - Mike